2026-03-29 20:15:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 20:15:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 20:15:04 [motorway.uk] INFO: Batch mode enabled: batch 4/4
2026-03-29 20:15:04 [motorway.uk] INFO: Starting spider motorway.uk
2026-03-29 20:15:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 20:15:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 20:15:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 20:15:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 20:15:05 [scrapy.extensions.telnet] INFO: Telnet Password: 38f8b03e6a045851
2026-03-29 20:15:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 20:15:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/motorway.uk/task_2_2026-03-29T20_15_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 20:15:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:15:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:15:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 20:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 20:15:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 20:15:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-29 20:15:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 20:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 20:15:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 20:15:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 20:15:05 [scrapy.core.engine] INFO: Spider opened
2026-03-29 20:15:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 20:15:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-03-29 20:15:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 20:15:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:15:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:15:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://pro.motorway.co.uk/api/login> (referer: None) ['zyte-api']
2026-03-29 20:15:13 [motorway.uk] INFO: Scrapy-formatted cookies: [{'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwiaWRlbnRpdHkiOiJleUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKcFpHVnVkR2wwYVdWeklqcGJleUpwWkNJNk9EUXlPU3dpWlcxaGFXd2lPaUpwYm1adlFITnJaR2x5WldOMExtTnZMblZySWl3aWRIbHdaU0k2SW1SbFlXeGxjaUlzSW1WNGNHbHlaWE1pT2lJeU1ESTJMVEEwTFRJNFZESXdPakUxT2pFeExqazBObG9pTENKd1lYSjBibVZ5Y3lJNlcxMTlYU3dpYVdGMElqb3hOemMwT0RFMU16RXhmUS5pNlRyNG9iVUdjaVR4a3BHQUlyYVBCQ2ctcno2dWE3YUUzUGhTSDFHY3hjIiwiZGVhbGVyUGVybWlzc2lvbnMiOlsiaW52b2ljaW5nIiwia3ljIl0sInJlZnJlc2hUb2tlbiI6ImQ4NDUxZjYzM2ZhM2ZiYzI3MTU4OTA0ODYyMGI3YzI3OGQ0YmNmMzBjODMwZTFjOTIyNjg4NmUzNmE5MDVjOTEiLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0ODE1MzEyODEwLCJpYXQiOjE3NzQ4MTUzMTIsImV4cCI6MTc3NDgxNTYxMn0.pdD7IPuYQ6kVprAwUnRJ3kA2xIrCPBgVlOdxBXUFTzU', 'domain': '.motorway.co.uk', 'path': '/'}]
2026-03-29 20:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk> (referer: https://pro.motorway.co.uk/api/login) ['zyte-api']
2026-03-29 20:15:17 [motorway.uk] INFO: Extracted Build ID: gL_OFaxoLv6tVLfo6F2-N
2026-03-29 20:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=buyItNow&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20210884
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720210884%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 20210884: 1
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 18349632
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20491343
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 19335779
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20478384
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20420964
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 19293050
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 11469561
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 16791811
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716791811%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 16791811: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 16345921
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20501784
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20434421
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20406874
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406874%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 20406874: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20486638
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 15631500
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 19204416
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20462868
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20403112
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20380533
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20438346
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438346%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 20438346: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 18341236
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718341236%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 18341236: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 19960036
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 19356442
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20217457
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20183041
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 17833819
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 6235966
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 8799286
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 12116877
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20485059
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485059%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 20485059: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 14687227
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714687227%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 14687227: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20371220
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20221411
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720221411%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 20221411: 0
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20482651
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482651%27 HTTP/1.1" 200 None
2026-03-29 20:15:19 [motorway.uk] INFO: Scrape type for 20482651: 1
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 20414596
2026-03-29 20:15:19 [motorway.uk] INFO: Found listing with ID: 13957348
2026-03-29 20:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20406874.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c788d128-b7b0-5692-a3fc-77b981e31744 with identifier: 20406874
2026-03-29 20:15:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c788d128-b7b0-5692-a3fc-77b981e31744 with scrape type 1
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Fexterior_front_driver-1774620124611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_driver-1774620124611.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Fexterior_rear_driver-1774620142503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_rear_driver-1774620142503.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Fexterior_front_passenger-1774620185858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_passenger-1774620185858.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Fexterior_rear_passenger-1774620173080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_rear_passenger-1774620173080.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6874%252F20406874%252Finterior_front_seats-1774620766366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6874/20406874/interior_front_seats-1774620766366.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6874%252F20406874%252Finterior_rear_seats-1774620791249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6874/20406874/interior_rear_seats-1774620791249.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Finterior_dashboard-1774620827105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/interior_dashboard-1774620827105.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Finstrument_cluster-1774620862591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/instrument_cluster-1774620862591.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6874%252F20406874%252Finterior_boot-1774621015353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6874/20406874/interior_boot-1774621015353.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6874%252F20406874%252Fdocs_service_history-1774697907589.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ef16494cb81083ea19cf8b701dbf1ee%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6874/20406874/docs_service_history-1774697907589.jpg?ixlib=js-3.8.0&auto=format&s=5ef16494cb81083ea19cf8b701dbf1ee not downloaded yet
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_passenger-1774620185858.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6874/20406874/instrument_cluster-1774620862591.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6874/20406874/interior_rear_seats-1774620791249.jpg> (referer: None)
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e02e250>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Fexterior_front_passenger-1774620185858.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_passenger-1774620185858.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20210884.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18341236.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec90ed0>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Finstrument_cluster-1774620862591.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/instrument_cluster-1774620862591.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec50210>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6874%252F20406874%252Finterior_rear_seats-1774620791249.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6874/20406874/interior_rear_seats-1774620791249.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6874/20406874/interior_dashboard-1774620827105.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_driver-1774620124611.jpg> (referer: None)
2026-03-29 20:15:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 with identifier: 20210884
2026-03-29 20:15:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 with scrape type 1
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_front_driver-1774710304075.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_driver-1774710304075.jpg not downloaded yet
2026-03-29 20:15:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab14c32-aa39-5333-88d1-feec49bca80e with identifier: 18341236
2026-03-29 20:15:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab14c32-aa39-5333-88d1-feec49bca80e with scrape type 1
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ab14c32-aa39-5333-88d1-feec49bca80e
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1236%252F18341236%252Fexterior_front_driver-1774614533923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1236/18341236/exterior_front_driver-1774614533923.jpg not downloaded yet
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_rear_driver-1774710300788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_driver-1774710300788.jpg not downloaded yet
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1236%252F18341236%252Fexterior_rear_driver-1774614556644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1236/18341236/exterior_rear_driver-1774614556644.jpg not downloaded yet
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c788d128-b7b0-5692-a3fc-77b981e31744 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c788d128-b7b0-5692-a3fc-77b981e31744 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_front_passenger-1774710306605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_passenger-1774710306605.jpg not downloaded yet
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1236%252F18341236%252Fexterior_front_passenger-1774614570257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1236/18341236/exterior_front_passenger-1774614570257.jpg not downloaded yet
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec93d50>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Finterior_dashboard-1774620827105.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/interior_dashboard-1774620827105.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d192010>
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6874%252F20406874%252Fexterior_front_driver-1774620124611.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_driver-1774620124611.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6874/20406874/interior_front_seats-1774620766366.jpg> (referer: None)
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_rear_passenger-1774710308306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_passenger-1774710308306.jpg not downloaded yet
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1236%252F18341236%252Fexterior_rear_passenger-1774614581200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1236/18341236/exterior_rear_passenger-1774614581200.jpg not downloaded yet
2026-03-29 20:15:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14687227.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16791811.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20482651.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485059.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0884%252F20210884%252Finterior_front_seats-1774710762153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0884/20210884/interior_front_seats-1774710762153.jpg not downloaded yet
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1236%252F18341236%252Finterior_front_seats-1774613078087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1236/18341236/interior_front_seats-1774613078087.jpg not downloaded yet
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Finterior_dashboard-1774710987821.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/interior_dashboard-1774710987821.jpg not downloaded yet
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1236%252F18341236%252Finterior_rear_seats-1774510574224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1236/18341236/interior_rear_seats-1774510574224.jpg not downloaded yet
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c788d128-b7b0-5692-a3fc-77b981e31744 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0884%252F20210884%252Finterior_boot-1774710723372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0884/20210884/interior_boot-1774710723372.jpg not downloaded yet
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1236%252F18341236%252Finterior_dashboard-1774614266874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1236/18341236/interior_dashboard-1774614266874.jpg not downloaded yet
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d303450>
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6874%252F20406874%252Finterior_front_seats-1774620766366.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6874/20406874/interior_front_seats-1774620766366.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c788d128-b7b0-5692-a3fc-77b981e31744
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0884%252F20210884%252Fdocs_service_history-1774712131379.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcec11a93d038e6c9783ee1f25e89cc68%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0884/20210884/docs_service_history-1774712131379.jpg?ixlib=js-3.8.0&auto=format&s=cec11a93d038e6c9783ee1f25e89cc68 not downloaded yet
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1236%252F18341236%252Finstrument_cluster-1774614491152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1236/18341236/instrument_cluster-1774614491152.jpg not downloaded yet
2026-03-29 20:15:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c788d128-b7b0-5692-a3fc-77b981e31744 with identifier: 20406874
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 20:15:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c788d128-b7b0-5692-a3fc-77b981e31744 with identifier: 20406874
2026-03-29 20:15:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c788d128-b7b0-5692-a3fc-77b981e31744 with identifier: 20406874 to the API
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:24 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'c788d128-b7b0-5692-a3fc-77b981e31744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'L21 HGL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20406874',
'listing': 'auction',
'location': 'Worcestershire Kidderminster',
'make': 'Polestar',
'model': '2',
'odometer': 23600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_driver-1774620124611.jpg',
'https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_rear_driver-1774620142503.jpg',
'https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_passenger-1774620185858.jpg',
'https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_rear_passenger-1774620173080.jpg',
'https://motorway-photos.imgix.net/6874/20406874/interior_front_seats-1774620766366.jpg',
'https://motorway-photos.imgix.net/6874/20406874/interior_rear_seats-1774620791249.jpg',
'https://motorway-photos-redacted.imgix.net/6874/20406874/interior_dashboard-1774620827105.jpg',
'https://motorway-photos-redacted.imgix.net/6874/20406874/instrument_cluster-1774620862591.jpg',
'https://motorway-photos.imgix.net/6874/20406874/interior_boot-1774621015353.jpg',
'https://motorway-service-history-photos.imgix.net/modified/6874/20406874/docs_service_history-1774697907589.jpg?ixlib=js-3.8.0&auto=format&s=5ef16494cb81083ea19cf8b701dbf1ee'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1792248,
'Height': 2557,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_driver-1774620124611.jpg',
'Width': 3409},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581748,
'Height': 2556,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6874/20406874/exterior_front_passenger-1774620185858.jpg',
'Width': 3408},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3095419,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6874/20406874/interior_front_seats-1774620766366.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2946869,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6874/20406874/interior_rear_seats-1774620791249.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1828148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6874/20406874/interior_dashboard-1774620827105.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c788d128-b7b0-5692-a3fc-77b981e31744/c788d128-b7b0-5692-a3fc-77b981e31744_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1936134,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6874/20406874/instrument_cluster-1774620862591.jpg',
'Width': 4032}],
'price': 20924,
'price_includes_vat': False,
'registration_date': '2023-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Polestar 2 Plus EV AWD',
'transmission': 'automatic',
'trim': 'Plus EV AWD',
'vin': 'YSMVSETE0PL172546',
'year': 2023}
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406874%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [motorway.uk] INFO: Saving data for 20406874: {'created_time': 1774815324.45885, 'last_price_update_time': 1774815324.458862, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20406874') HTTP/1.1" 204 0
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c788d128-b7b0-5692-a3fc-77b981e31744 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0884%252F20210884%252Fdocs_service_history-1774712145952.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c78f4c902b5d5edefcd020927e96b97%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0884/20210884/docs_service_history-1774712145952.jpg?ixlib=js-3.8.0&auto=format&s=8c78f4c902b5d5edefcd020927e96b97 not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1236%252F18341236%252Finterior_boot-1774510567493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1236/18341236/interior_boot-1774510567493.jpg not downloaded yet
2026-03-29 20:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9425fe9f-4e90-512b-b65b-bd4a550f8341 with identifier: 14687227
2026-03-29 20:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 with scrape type 1
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9425fe9f-4e90-512b-b65b-bd4a550f8341
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7227%252F14687227%252F14687227-exterior_front_driver-modified-1774692888780.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7227/14687227/14687227-exterior_front_driver-modified-1774692888780.jpeg not downloaded yet
2026-03-29 20:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 with identifier: 16791811
2026-03-29 20:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 with scrape type 1
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Fexterior_front_driver-1774714815732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_front_driver-1774714815732.jpg not downloaded yet
2026-03-29 20:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f248ce2-c32d-540c-b4e0-5d3d110e06ed with identifier: 20482651
2026-03-29 20:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed with scrape type 1
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_front_driver-1774680457034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_front_driver-1774680457034.jpg not downloaded yet
2026-03-29 20:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d3fd35b-656c-516e-a929-be67fff9c10f with identifier: 20485059
2026-03-29 20:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d3fd35b-656c-516e-a929-be67fff9c10f with scrape type 1
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_front_driver-1774693250590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_driver-1774693250590.jpg not downloaded yet
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0884%252F20210884%252Fdocs_service_history-1774712402690.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc0d1dcce9aa15d8b2bde2cb4c1cc0f32%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0884/20210884/docs_service_history-1774712402690.jpg?ixlib=js-3.8.0&auto=format&s=c0d1dcce9aa15d8b2bde2cb4c1cc0f32 not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1236%252F18341236%252Fdamage_warning_lights-1774614498688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1236/18341236/damage_warning_lights-1774614498688.jpg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7227%252F14687227%252F14687227-exterior_rear_driver-modified-1774692868969.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7227/14687227/14687227-exterior_rear_driver-modified-1774692868969.jpeg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Fexterior_rear_driver-1774714884709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_driver-1774714884709.jpg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_rear_driver-1774680470718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_driver-1774680470718.jpg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_rear_driver-1774693375608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_driver-1774693375608.jpg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7227%252F14687227%252Fexterior_front_passenger-1774688292323.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7227/14687227/exterior_front_passenger-1774688292323.jpeg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Fexterior_front_passenger-1774714853092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_front_passenger-1774714853092.jpg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_front_passenger-1774680492837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_front_passenger-1774680492837.jpg not downloaded yet
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_front_passenger-1774693340720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_passenger-1774693340720.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7227%252F14687227%252Fexterior_rear_passenger-1774688310068.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7227/14687227/exterior_rear_passenger-1774688310068.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Fexterior_rear_passenger-1774714840991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_passenger-1774714840991.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_rear_passenger-1774680480389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_passenger-1774680480389.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_rear_passenger-1774693276287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_passenger-1774693276287.jpg not downloaded yet
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_driver-1774710304075.jpg> (referer: None)
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7227%252F14687227%252Finterior_front_seats-1774688334837.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7227/14687227/interior_front_seats-1774688334837.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F16791811%252Finterior_front_seats-1774715100917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/16791811/interior_front_seats-1774715100917.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2651%252F20482651%252Finterior_front_seats-1774680918095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2651/20482651/interior_front_seats-1774680918095.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5059%252F20485059%252Finterior_front_seats-1774693866875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5059/20485059/interior_front_seats-1774693866875.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7227%252F14687227%252F14687227-interior_rear_seats-modified-1774692840288.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7227/14687227/14687227-interior_rear_seats-modified-1774692840288.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F16791811%252Finterior_rear_seats-1774715754167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/16791811/interior_rear_seats-1774715754167.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2651%252F20482651%252Finterior_rear_seats-1774680981071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2651/20482651/interior_rear_seats-1774680981071.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5059%252F20485059%252Finterior_rear_seats-1774693937720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5059/20485059/interior_rear_seats-1774693937720.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7227%252F14687227%252F14687227-interior_dashboard-modified-1774692820977.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7227/14687227/14687227-interior_dashboard-modified-1774692820977.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1811%252F16791811%252Finterior_dashboard-1774781614855.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1811/16791811/interior_dashboard-1774781614855.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2651%252F20482651%252Finterior_dashboard-1774693351814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2651/20482651/interior_dashboard-1774693351814.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5059%252F20485059%252Finterior_dashboard-1774694947553.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5059/20485059/interior_dashboard-1774694947553.jpg not downloaded yet
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_driver-1774710300788.jpg> (referer: None)
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20438346.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d9510>
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_front_driver-1774710304075.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_driver-1774710304075.jpg saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7227%252F14687227%252F14687227-interior_boot-modified-1774692799734.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7227/14687227/14687227-interior_boot-modified-1774692799734.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Finstrument_cluster-1774715217419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/instrument_cluster-1774715217419.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2651%252F20482651%252Finterior_boot-1774680846505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2651/20482651/interior_boot-1774680846505.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Finstrument_cluster-1774693968948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/instrument_cluster-1774693968948.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7227%252F14687227%252Fwheels_front_driver-1774688829360.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_front_driver-1774688829360.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F16791811%252Finterior_boot-1774715186297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/16791811/interior_boot-1774715186297.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2651%252F20482651%252Fdocs_service_history-1774681263711.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8896d05f9c4dca2ca47427a52cd2c109%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2651/20482651/docs_service_history-1774681263711.jpg?ixlib=js-3.8.0&auto=format&s=8896d05f9c4dca2ca47427a52cd2c109 not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5059%252F20485059%252Finterior_boot-1774694003159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5059/20485059/interior_boot-1774694003159.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7227%252F14687227%252Fwheels_rear_driver-1774688777653.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_rear_driver-1774688777653.jpeg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1811%252F16791811%252Fdocs_service_history-1774715918922.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da40a5a028dac75916c0f3163f806e08d%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/16791811/docs_service_history-1774715918922.jpg?ixlib=js-3.8.0&auto=format&s=a40a5a028dac75916c0f3163f806e08d not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fwheels_front_driver-1774680643041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/wheels_front_driver-1774680643041.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5059%252F20485059%252Fdocs_service_history-1774783720414.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95e77c97a54b6b7d27ee732100431398%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5059/20485059/docs_service_history-1774783720414.jpg?ixlib=js-3.8.0&auto=format&s=95e77c97a54b6b7d27ee732100431398 not downloaded yet
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e073550>
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_rear_driver-1774710300788.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_driver-1774710300788.jpg saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491
2026-03-29 20:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 851ef4d3-1408-5dda-adff-3518ab277354 with identifier: 20438346
2026-03-29 20:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851ef4d3-1408-5dda-adff-3518ab277354 with scrape type 1
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_front_driver-1774442174321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_driver-1774442174321.jpg not downloaded yet
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_passenger-1774710308306.jpg> (referer: None)
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_rear_driver-1774442112351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_driver-1774442112351.jpg not downloaded yet
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1236/18341236/interior_rear_seats-1774510574224.jpg> (referer: None)
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_front_passenger-1774442160994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_passenger-1774442160994.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_rear_passenger-1774442142704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_passenger-1774442142704.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8346%252F20438346%252Finterior_front_seats-1774524995771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8346/20438346/interior_front_seats-1774524995771.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8346%252F20438346%252Finterior_rear_seats-1774525030913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8346/20438346/interior_rear_seats-1774525030913.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Finterior_dashboard-1774525093655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/interior_dashboard-1774525093655.jpg not downloaded yet
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed91250>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Fexterior_rear_passenger-1774710308306.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_passenger-1774710308306.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c0c6d0>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab14c32-aa39-5333-88d1-feec49bca80e/5ab14c32-aa39-5333-88d1-feec49bca80e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1236%252F18341236%252Finterior_rear_seats-1774510574224.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1236/18341236/interior_rear_seats-1774510574224.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ab14c32-aa39-5333-88d1-feec49bca80e
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Finstrument_cluster-1774525083888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/instrument_cluster-1774525083888.jpg not downloaded yet
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8346%252F20438346%252Finterior_boot-1774525119470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8346/20438346/interior_boot-1774525119470.jpg not downloaded yet
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0884/20210884/interior_dashboard-1774710987821.jpg> (referer: None)
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8346%252F20438346%252Fdocs_service_history-1774700643080.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde24661427cf123e4a809e914c17ab9d%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8346/20438346/docs_service_history-1774700643080.png?ixlib=js-3.8.0&auto=format&s=de24661427cf123e4a809e914c17ab9d not downloaded yet
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0884/20210884/interior_boot-1774710723372.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_driver-1774442174321.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_passenger-1774693340720.jpg> (referer: None)
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_driver-1774442112351.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5059/20485059/interior_boot-1774694003159.jpg> (referer: None)
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e06eb90>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0884%252F20210884%252Finterior_dashboard-1774710987821.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0884/20210884/interior_dashboard-1774710987821.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec92d90>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0884%252F20210884%252Finterior_boot-1774710723372.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0884/20210884/interior_boot-1774710723372.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2113d0>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_front_driver-1774442174321.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_driver-1774442174321.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec9c4d0>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_front_passenger-1774693340720.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_passenger-1774693340720.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c213dd0>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_rear_driver-1774442112351.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_driver-1774442112351.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1bce90>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5059%252F20485059%252Finterior_boot-1774694003159.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5059/20485059/interior_boot-1774694003159.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 7d3fd35b-656c-516e-a929-be67fff9c10f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7d3fd35b-656c-516e-a929-be67fff9c10f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 851ef4d3-1408-5dda-adff-3518ab277354 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7d3fd35b-656c-516e-a929-be67fff9c10f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8346/20438346/instrument_cluster-1774525083888.jpg> (referer: None)
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_passenger-1774442142704.jpg> (referer: None)
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8346/20438346/interior_boot-1774525119470.jpg> (referer: None)
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8346/20438346/interior_front_seats-1774524995771.jpg> (referer: None)
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e064510>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Finstrument_cluster-1774525083888.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/instrument_cluster-1774525083888.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1a6b10>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8346%252F20438346%252Fexterior_rear_passenger-1774442142704.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_passenger-1774442142704.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec39310>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8346%252F20438346%252Finterior_boot-1774525119470.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8346/20438346/interior_boot-1774525119470.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9da810>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8346%252F20438346%252Finterior_front_seats-1774524995771.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8346/20438346/interior_front_seats-1774524995771.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 851ef4d3-1408-5dda-adff-3518ab277354
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_front_driver-1774688829360.jpeg> (referer: None)
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 851ef4d3-1408-5dda-adff-3518ab277354 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 851ef4d3-1408-5dda-adff-3518ab277354 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 851ef4d3-1408-5dda-adff-3518ab277354 with identifier: 20438346
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-03-29 20:15:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 20:15:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 851ef4d3-1408-5dda-adff-3518ab277354 with identifier: 20438346
2026-03-29 20:15:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 851ef4d3-1408-5dda-adff-3518ab277354 with identifier: 20438346 to the API
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '851ef4d3-1408-5dda-adff-3518ab277354',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LU51 ROX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20438346',
'listing': 'auction',
'location': 'Essex Colchester',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 70891,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_driver-1774442174321.jpg',
'https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_driver-1774442112351.jpg',
'https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_passenger-1774442160994.jpg',
'https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_passenger-1774442142704.jpg',
'https://motorway-photos.imgix.net/8346/20438346/interior_front_seats-1774524995771.jpg',
'https://motorway-photos.imgix.net/8346/20438346/interior_rear_seats-1774525030913.jpg',
'https://motorway-photos-redacted.imgix.net/8346/20438346/interior_dashboard-1774525093655.jpg',
'https://motorway-photos-redacted.imgix.net/8346/20438346/instrument_cluster-1774525083888.jpg',
'https://motorway-photos.imgix.net/8346/20438346/interior_boot-1774525119470.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8346/20438346/docs_service_history-1774700643080.png?ixlib=js-3.8.0&auto=format&s=de24661427cf123e4a809e914c17ab9d'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1140673,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_front_driver-1774442174321.jpg',
'Width': 2983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1502119,
'Height': 2662,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_driver-1774442112351.jpg',
'Width': 3549},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548166,
'Height': 2861,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8346/20438346/exterior_rear_passenger-1774442142704.jpg',
'Width': 3815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2895711,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8346/20438346/interior_front_seats-1774524995771.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1043990,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8346/20438346/instrument_cluster-1774525083888.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851ef4d3-1408-5dda-adff-3518ab277354/851ef4d3-1408-5dda-adff-3518ab277354_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3313469,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8346/20438346/interior_boot-1774525119470.jpg',
'Width': 4032}],
'price': 24357,
'price_includes_vat': False,
'registration_date': '2019-04-09',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Vogue SE SDV6 Auto',
'transmission': 'automatic',
'trim': 'Vogue SE SDV6 Auto',
'vin': 'SALGA2AK3KA557806',
'year': 2019}
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438346%27 HTTP/1.1" 200 None
2026-03-29 20:15:28 [motorway.uk] INFO: Saving data for 20438346: {'created_time': 1774815328.825949, 'last_price_update_time': 1774815328.825961, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20438346') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 851ef4d3-1408-5dda-adff-3518ab277354 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5059/20485059/instrument_cluster-1774693968948.jpg> (referer: None)
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=36&page=1&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54d850>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9425fe9f-4e90-512b-b65b-bd4a550f8341/9425fe9f-4e90-512b-b65b-bd4a550f8341_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7227%252F14687227%252Fwheels_front_driver-1774688829360.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_front_driver-1774688829360.jpeg saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 7d3fd35b-656c-516e-a929-be67fff9c10f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6300d0>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Finstrument_cluster-1774693968948.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/instrument_cluster-1774693968948.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 12213512
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20488190
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20491954
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 18395283
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20007284
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 10801992
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 19925917
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 19874916
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719874916%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 19874916: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20226377
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720226377%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 20226377: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20343618
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 19943436
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20452938
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 17257209
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20481812
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481812%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 20481812: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 19560308
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719560308%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 19560308: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20485589
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485589%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 20485589: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20425191
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 9396121
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 19478931
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719478931%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 19478931: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20428242
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428242%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 20428242: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20451701
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20458099
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 15842916
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20460677
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 18909824
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20468920
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 9709918
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279709918%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [motorway.uk] INFO: Scrape type for 9709918: 1
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20449963
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 16442218
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20468049
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 18710113
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 9721294
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20454912
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 10856544
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 20471927
2026-03-29 20:15:29 [motorway.uk] INFO: Found listing with ID: 18459962
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_passenger-1774714840991.jpg> (referer: None)
2026-03-29 20:15:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2651/20482651/interior_rear_seats-1774680981071.jpg> (referer: None)
2026-03-29 20:15:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1811/16791811/interior_rear_seats-1774715754167.jpg> (referer: None)
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_passenger-1774693276287.jpg> (referer: None)
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_driver-1774693375608.jpg> (referer: None)
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c65aa50>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8/f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Fexterior_rear_passenger-1774714840991.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_passenger-1774714840991.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_passenger-1774680480389.jpg> (referer: None)
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d128f10>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2651%252F20482651%252Finterior_rear_seats-1774680981071.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2651/20482651/interior_rear_seats-1774680981071.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e009e10>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8/f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F16791811%252Finterior_rear_seats-1774715754167.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/16791811/interior_rear_seats-1774715754167.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1aa910>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_rear_passenger-1774693276287.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_passenger-1774693276287.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d724310>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_rear_driver-1774693375608.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_driver-1774693375608.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec81910>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_rear_passenger-1774680480389.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_passenger-1774680480389.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 5ab14c32-aa39-5333-88d1-feec49bca80e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_driver-1774714884709.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_driver-1774680470718.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_front_driver-1774680457034.jpg> (referer: None)
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d187610>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8/f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F16791811%252Fexterior_rear_driver-1774714884709.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_driver-1774714884709.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d184910>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_rear_driver-1774680470718.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_driver-1774680470718.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa6c10>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2651%252F20482651%252Fexterior_front_driver-1774680457034.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_front_driver-1774680457034.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed
2026-03-29 20:15:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f248ce2-c32d-540c-b4e0-5d3d110e06ed, skipping ID generation
2026-03-29 20:15:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed with scrape type 1
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f248ce2-c32d-540c-b4e0-5d3d110e06ed sending to next pipeline
2026-03-29 20:15:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5f248ce2-c32d-540c-b4e0-5d3d110e06ed, identifier: 20482651
2026-03-29 20:15:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5f248ce2-c32d-540c-b4e0-5d3d110e06ed with identifier: 20482651
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5f248ce2-c32d-540c-b4e0-5d3d110e06ed with identifier: 20482651
2026-03-29 20:15:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5f248ce2-c32d-540c-b4e0-5d3d110e06ed with identifier: 20482651 to the API
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_front_driver-1774680457034.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '6.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5f248ce2-c32d-540c-b4e0-5d3d110e06ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SKY 121J',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20482651',
'listing': 'auction',
'location': 'Dorset Wareham',
'make': 'Bentley',
'model': 'Continental',
'odometer': 27000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2374230,
'Height': 2619,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_front_driver-1774680457034.jpg',
'Width': 3492},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1856680,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_driver-1774680470718.jpg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2607907,
'Height': 2940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2651/20482651/exterior_rear_passenger-1774680480389.jpg',
'Width': 3920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f248ce2-c32d-540c-b4e0-5d3d110e06ed/5f248ce2-c32d-540c-b4e0-5d3d110e06ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2517055,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2651/20482651/interior_rear_seats-1774680981071.jpg',
'Width': 4032}],
'price': 81860,
'price_includes_vat': False,
'registration_date': '2018-06-25',
'seats_number': None,
'seller_name': None,
'title': 'Bentley Continental GT Auto',
'transmission': 'automatic',
'trim': 'GT Auto',
'vin': 'SCBCA13S4JC068575',
'year': 2018}
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482651%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [motorway.uk] INFO: Saving data for 20482651: {'created_time': 1774815331.723316, 'last_price_update_time': 1774815331.723327, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20482651') HTTP/1.1" 204 0
2026-03-29 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1236/18341236/interior_boot-1774510567493.jpg> (referer: None)
2026-03-29 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_driver-1774693250590.jpg> (referer: None)
2026-03-29 20:15:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9425fe9f-4e90-512b-b65b-bd4a550f8341 with identifier: 14687227
2026-03-29 20:15:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9425fe9f-4e90-512b-b65b-bd4a550f8341 with identifier: 14687227
2026-03-29 20:15:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9425fe9f-4e90-512b-b65b-bd4a550f8341 with identifier: 14687227 to the API
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:33 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '9425fe9f-4e90-512b-b65b-bd4a550f8341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX74 OHR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14687227',
'listing': 'auction',
'location': 'Greater London Pinner',
'make': 'Porsche',
'model': 'Macan',
'odometer': 10353,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://motorway-photos-modified.imgix.net/7227/14687227/14687227-exterior_front_driver-modified-1774692888780.jpeg',
'https://motorway-photos-modified.imgix.net/7227/14687227/14687227-exterior_rear_driver-modified-1774692868969.jpeg',
'https://motorway-photos-redacted.imgix.net/7227/14687227/exterior_front_passenger-1774688292323.jpeg',
'https://motorway-photos-redacted.imgix.net/7227/14687227/exterior_rear_passenger-1774688310068.jpeg',
'https://motorway-photos.imgix.net/7227/14687227/interior_front_seats-1774688334837.jpeg',
'https://motorway-photos-modified.imgix.net/7227/14687227/14687227-interior_rear_seats-modified-1774692840288.jpeg',
'https://motorway-photos-modified.imgix.net/7227/14687227/14687227-interior_dashboard-modified-1774692820977.jpeg',
'https://motorway-photos-modified.imgix.net/7227/14687227/14687227-interior_boot-modified-1774692799734.jpeg',
'https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_front_driver-1774688829360.jpeg',
'https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_rear_driver-1774688777653.jpeg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9425fe9f-4e90-512b-b65b-bd4a550f8341/9425fe9f-4e90-512b-b65b-bd4a550f8341_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1487272,
'Height': 2574,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7227/14687227/wheels_front_driver-1774688829360.jpeg',
'Width': 3432}],
'price': 87580,
'price_includes_vat': False,
'registration_date': '2024-10-29',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan Turbo Electric',
'transmission': 'automatic',
'trim': 'Turbo Electric',
'vin': 'WP1ZZZXA3RL202533',
'year': 2024}
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714687227%27 HTTP/1.1" 200 None
2026-03-29 20:15:33 [motorway.uk] INFO: Saving data for 14687227: {'created_time': 1774815333.309462, 'last_price_update_time': 1774815333.309474, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14687227') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 9425fe9f-4e90-512b-b65b-bd4a550f8341 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 with identifier: 16791811
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-03-29 20:15:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 with identifier: 16791811
2026-03-29 20:15:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 with identifier: 16791811 to the API
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:34 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'W1 SPA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16791811',
'listing': 'auction',
'location': 'Hertfordshire Hoddesdon',
'make': 'Aston Martin',
'model': 'DB11',
'odometer': 25304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_front_driver-1774714815732.jpg',
'https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_driver-1774714884709.jpg',
'https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_front_passenger-1774714853092.jpg',
'https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_passenger-1774714840991.jpg',
'https://motorway-photos.imgix.net/1811/16791811/interior_front_seats-1774715100917.jpg',
'https://motorway-photos.imgix.net/1811/16791811/interior_rear_seats-1774715754167.jpg',
'https://motorway-photos-modified.imgix.net/1811/16791811/interior_dashboard-1774781614855.jpg',
'https://motorway-photos-redacted.imgix.net/1811/16791811/instrument_cluster-1774715217419.jpg',
'https://motorway-photos.imgix.net/1811/16791811/interior_boot-1774715186297.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/16791811/docs_service_history-1774715918922.jpg?ixlib=js-3.8.0&auto=format&s=a40a5a028dac75916c0f3163f806e08d'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8/f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1382298,
'Height': 2207,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_driver-1774714884709.jpg',
'Width': 2942},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8/f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1826343,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1811/16791811/exterior_rear_passenger-1774714840991.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8/f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2811075,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1811/16791811/interior_rear_seats-1774715754167.jpg',
'Width': 4032}],
'price': 63932,
'price_includes_vat': False,
'registration_date': '2018-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Aston Martin DB11 V8 Auto',
'transmission': 'automatic',
'trim': 'V8 Auto',
'vin': 'SCFRLFAW6JGL04562',
'year': 2018}
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716791811%27 HTTP/1.1" 200 None
2026-03-29 20:15:34 [motorway.uk] INFO: Saving data for 16791811: {'created_time': 1774815334.889216, 'last_price_update_time': 1774815334.889229, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16791811') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 with identifier: 20210884
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Orange HTTP/1.1" 200 None
2026-03-29 20:15:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 with identifier: 20210884
2026-03-29 20:15:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 with identifier: 20210884 to the API
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:35 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6f6e78f9-60dd-552e-ac2c-3b3125d6b491',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE18 YEG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20210884',
'listing': 'auction',
'location': 'Greater Manchester Wigan',
'make': 'McLaren',
'model': '720S',
'odometer': 40156,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_driver-1774710304075.jpg',
'https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_driver-1774710300788.jpg',
'https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_passenger-1774710306605.jpg',
'https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_passenger-1774710308306.jpg',
'https://motorway-photos.imgix.net/0884/20210884/interior_front_seats-1774710762153.jpg',
'https://motorway-photos-redacted.imgix.net/0884/20210884/interior_dashboard-1774710987821.jpg',
'https://motorway-photos.imgix.net/0884/20210884/interior_boot-1774710723372.jpg',
'https://motorway-service-history-photos.imgix.net/modified/0884/20210884/docs_service_history-1774712131379.jpg?ixlib=js-3.8.0&auto=format&s=cec11a93d038e6c9783ee1f25e89cc68',
'https://motorway-service-history-photos.imgix.net/modified/0884/20210884/docs_service_history-1774712145952.jpg?ixlib=js-3.8.0&auto=format&s=8c78f4c902b5d5edefcd020927e96b97',
'https://motorway-service-history-photos.imgix.net/modified/0884/20210884/docs_service_history-1774712402690.jpg?ixlib=js-3.8.0&auto=format&s=c0d1dcce9aa15d8b2bde2cb4c1cc0f32'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1173280,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_front_driver-1774710304075.jpg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 999042,
'Height': 2478,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_driver-1774710300788.jpg',
'Width': 3304},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 897512,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0884/20210884/exterior_rear_passenger-1774710308306.jpg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1727957,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0884/20210884/interior_dashboard-1774710987821.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f6e78f9-60dd-552e-ac2c-3b3125d6b491/6f6e78f9-60dd-552e-ac2c-3b3125d6b491_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2051321,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0884/20210884/interior_boot-1774710723372.jpg',
'Width': 3840}],
'price': 96424,
'price_includes_vat': False,
'registration_date': '2018-03-03',
'seats_number': None,
'seller_name': None,
'title': 'McLaren 720S V8 S-A',
'transmission': 'automatic',
'trim': 'V8 S-A',
'vin': 'SBM14DCC2JW001386',
'year': 2018}
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720210884%27 HTTP/1.1" 200 None
2026-03-29 20:15:35 [motorway.uk] INFO: Saving data for 20210884: {'created_time': 1774815335.488539, 'last_price_update_time': 1774815335.488552, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20210884') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item f6bb46f7-8f22-582f-8dc6-3f4f63f55cb8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=72&page=2&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 6f6e78f9-60dd-552e-ac2c-3b3125d6b491 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca9a010>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ab14c32-aa39-5333-88d1-feec49bca80e/5ab14c32-aa39-5333-88d1-feec49bca80e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1236%252F18341236%252Finterior_boot-1774510567493.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1236/18341236/interior_boot-1774510567493.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ab14c32-aa39-5333-88d1-feec49bca80e
2026-03-29 20:15:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ab14c32-aa39-5333-88d1-feec49bca80e, skipping ID generation
2026-03-29 20:15:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab14c32-aa39-5333-88d1-feec49bca80e with scrape type 1
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ab14c32-aa39-5333-88d1-feec49bca80e sending to next pipeline
2026-03-29 20:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5ab14c32-aa39-5333-88d1-feec49bca80e, identifier: 18341236
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16ec90>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5059%252F20485059%252Fexterior_front_driver-1774693250590.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_driver-1774693250590.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d3fd35b-656c-516e-a929-be67fff9c10f
2026-03-29 20:15:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d3fd35b-656c-516e-a929-be67fff9c10f, skipping ID generation
2026-03-29 20:15:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d3fd35b-656c-516e-a929-be67fff9c10f with scrape type 1
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d3fd35b-656c-516e-a929-be67fff9c10f sending to next pipeline
2026-03-29 20:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7d3fd35b-656c-516e-a929-be67fff9c10f, identifier: 20485059
2026-03-29 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20226377.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485589.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20481812.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9709918.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5ab14c32-aa39-5333-88d1-feec49bca80e with identifier: 18341236
2026-03-29 20:15:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5ab14c32-aa39-5333-88d1-feec49bca80e with identifier: 18341236
2026-03-29 20:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5ab14c32-aa39-5333-88d1-feec49bca80e with identifier: 18341236 to the API
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1236/18341236/interior_boot-1774510567493.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '5ab14c32-aa39-5333-88d1-feec49bca80e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK73 BGZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18341236',
'listing': 'auction',
'location': 'Surrey Banstead',
'make': 'Porsche',
'model': 'Taycan',
'odometer': 4750,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab14c32-aa39-5333-88d1-feec49bca80e/5ab14c32-aa39-5333-88d1-feec49bca80e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1090561,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1236/18341236/interior_rear_seats-1774510574224.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ab14c32-aa39-5333-88d1-feec49bca80e/5ab14c32-aa39-5333-88d1-feec49bca80e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1420733,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1236/18341236/interior_boot-1774510567493.jpg',
'Width': 3840}],
'price': 51146,
'price_includes_vat': False,
'registration_date': '2023-11-03',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Taycan 4S 93KWH',
'transmission': 'automatic',
'trim': '4S 93KWH',
'vin': 'WP0ZZZY19RSA30634',
'year': 2023}
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718341236%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [motorway.uk] INFO: Saving data for 18341236: {'created_time': 1774815336.271275, 'last_price_update_time': 1774815336.27129, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18341236') HTTP/1.1" 204 0
2026-03-29 20:15:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7d3fd35b-656c-516e-a929-be67fff9c10f with identifier: 20485059
2026-03-29 20:15:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7d3fd35b-656c-516e-a929-be67fff9c10f with identifier: 20485059
2026-03-29 20:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7d3fd35b-656c-516e-a929-be67fff9c10f with identifier: 20485059 to the API
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_driver-1774693250590.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7d3fd35b-656c-516e-a929-be67fff9c10f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SA72 EOO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485059',
'listing': 'auction',
'location': 'Pembrokeshire Kilgetty',
'make': 'Audi',
'model': 'SQ5',
'odometer': 28486,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2154613,
'Height': 2953,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_driver-1774693250590.jpg',
'Width': 3937},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2061284,
'Height': 2990,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_driver-1774693375608.jpg',
'Width': 3986},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977101,
'Height': 2786,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_front_passenger-1774693340720.jpg',
'Width': 3715},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989591,
'Height': 2724,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5059/20485059/exterior_rear_passenger-1774693276287.jpg',
'Width': 3632},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2204879,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5059/20485059/instrument_cluster-1774693968948.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3fd35b-656c-516e-a929-be67fff9c10f/7d3fd35b-656c-516e-a929-be67fff9c10f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3773259,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5059/20485059/interior_boot-1774694003159.jpg',
'Width': 4032}],
'price': 39944,
'price_includes_vat': False,
'registration_date': '2022-10-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi SQ5 TDI MHEV Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI MHEV Quattro Auto',
'vin': 'WAUZZZFY2P2004786',
'year': 2022}
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485059%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [motorway.uk] INFO: Saving data for 20485059: {'created_time': 1774815336.666554, 'last_price_update_time': 1774815336.666567, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485059') HTTP/1.1" 204 0
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19560308.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:36 [motorway.uk] INFO: Found listing with ID: 6579411
2026-03-29 20:15:36 [motorway.uk] INFO: Found listing with ID: 18288929
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718288929%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [motorway.uk] INFO: Scrape type for 18288929: 1
2026-03-29 20:15:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39b0b287-3a81-514f-8d33-24d742a7a3be with identifier: 20226377
2026-03-29 20:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b0b287-3a81-514f-8d33-24d742a7a3be with scrape type 1
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39b0b287-3a81-514f-8d33-24d742a7a3be
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6377%252F20226377%252Fexterior_front_driver-1773302476171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_front_driver-1773302476171.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6377%252F20226377%252Fexterior_rear_driver-1773302500279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_rear_driver-1773302500279.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6377%252F20226377%252Fexterior_front_passenger-1773303143107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_front_passenger-1773303143107.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6377%252F20226377%252Fexterior_rear_passenger-1773302515998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_rear_passenger-1773302515998.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6377%252F20226377%252Finterior_front_seats-1773303090140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6377/20226377/interior_front_seats-1773303090140.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6377%252F20226377%252Finterior_rear_seats-1773302786632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6377/20226377/interior_rear_seats-1773302786632.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6377%252F20226377%252Finterior_dashboard-1773302805791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6377/20226377/interior_dashboard-1773302805791.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6377%252F20226377%252Finstrument_cluster-1773302884070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6377/20226377/instrument_cluster-1773302884070.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6377%252F20226377%252Finterior_boot-1773302809648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6377/20226377/interior_boot-1773302809648.jpg already downloaded
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6377%252F20226377%252Fdocs_service_history-1773302887340.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd2a7a6914b3e4eb39823e80f0080af2e%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6377/20226377/docs_service_history-1773302887340.jpg?ixlib=js-3.8.0&auto=format&s=d2a7a6914b3e4eb39823e80f0080af2e already downloaded
2026-03-29 20:15:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 39b0b287-3a81-514f-8d33-24d742a7a3be, identifier: 20226377
2026-03-29 20:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 with identifier: 20485589
2026-03-29 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 with scrape type 1
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5589%252F20485589%252Fexterior_front_driver-1774700332686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_driver-1774700332686.jpg not downloaded yet
2026-03-29 20:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9b8a8d-a478-541b-b983-06c5cbd50afe with identifier: 20481812
2026-03-29 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe with scrape type 1
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1812%252F20481812%252Fexterior_front_driver-1774693138420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_driver-1774693138420.jpg not downloaded yet
2026-03-29 20:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 with identifier: 9709918
2026-03-29 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 with scrape type 1
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_front_driver-1774784737628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_front_driver-1774784737628.jpg not downloaded yet
2026-03-29 20:15:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 39b0b287-3a81-514f-8d33-24d742a7a3be with identifier: 20226377
2026-03-29 20:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 39b0b287-3a81-514f-8d33-24d742a7a3be with identifier: 20226377
2026-03-29 20:15:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 39b0b287-3a81-514f-8d33-24d742a7a3be with identifier: 20226377 to the API
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20226377.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '39b0b287-3a81-514f-8d33-24d742a7a3be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J222 CAT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20226377',
'listing': 'auction',
'location': 'Nottinghamshire Mansfield',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 52159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_front_driver-1773302476171.jpg',
'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_rear_driver-1773302500279.jpg',
'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_front_passenger-1773303143107.jpg',
'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_rear_passenger-1773302515998.jpg',
'https://motorway-photos.imgix.net/6377/20226377/interior_front_seats-1773303090140.jpg',
'https://motorway-photos.imgix.net/6377/20226377/interior_rear_seats-1773302786632.jpg',
'https://motorway-photos-redacted.imgix.net/6377/20226377/interior_dashboard-1773302805791.jpg',
'https://motorway-photos-redacted.imgix.net/6377/20226377/instrument_cluster-1773302884070.jpg',
'https://motorway-photos.imgix.net/6377/20226377/interior_boot-1773302809648.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/6377/20226377/docs_service_history-1773302887340.jpg?ixlib=js-3.8.0&auto=format&s=d2a7a6914b3e4eb39823e80f0080af2e'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1638001,
'Height': 2712,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_front_driver-1773302476171.jpg',
'Width': 3616},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432037,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_rear_driver-1773302500279.jpg',
'Width': 3190},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1553113,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_front_passenger-1773303143107.jpg',
'Width': 3183},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2328411,
'Height': 2849,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6377/20226377/exterior_rear_passenger-1773302515998.jpg',
'Width': 3799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2853529,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6377/20226377/interior_front_seats-1773303090140.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2416632,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6377/20226377/interior_rear_seats-1773302786632.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1558251,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6377/20226377/interior_dashboard-1773302805791.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575775,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6377/20226377/instrument_cluster-1773302884070.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2475603,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6377/20226377/interior_boot-1773302809648.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b0b287-3a81-514f-8d33-24d742a7a3be/39b0b287-3a81-514f-8d33-24d742a7a3be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394360,
'Height': 1614,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6377/20226377/docs_service_history-1773302887340.jpg?ixlib=js-3.8.0&auto=format&s=d2a7a6914b3e4eb39823e80f0080af2e',
'Width': 1125}],
'price': 26513,
'price_includes_vat': False,
'registration_date': '2018-09-26',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Rrover Sport A-BIO DYN SDV6 A',
'transmission': 'automatic',
'trim': 'Rrover Sport A-BIO DYN SDV6 A',
'vin': 'SALWA2AK2KA814272',
'year': 2018}
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720226377%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [motorway.uk] INFO: Saving data for 20226377: {'created_time': 1774815337.529938, 'last_price_update_time': 1774815337.529951, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20226377') HTTP/1.1" 204 0
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 10230435
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20413878
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20489985
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20266437
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 18704338
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20479276
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479276%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [motorway.uk] INFO: Scrape type for 20479276: 1
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5589%252F20485589%252Fexterior_rear_driver-1774701867794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5589/20485589/exterior_rear_driver-1774701867794.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1812%252F20481812%252Fexterior_rear_driver-1774693167137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_rear_driver-1774693167137.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_rear_driver-1774784713557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_driver-1774784713557.jpg not downloaded yet
2026-03-29 20:15:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 13909960
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20487021
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 19601663
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719601663%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [motorway.uk] INFO: Scrape type for 19601663: 1
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5589%252F20485589%252Fexterior_front_passenger-1774700341926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_passenger-1774700341926.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1812%252F20481812%252Fexterior_front_passenger-1774693291748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_passenger-1774693291748.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_front_passenger-1774784774987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_front_passenger-1774784774987.jpg not downloaded yet
2026-03-29 20:15:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96553639-abb3-5226-a7a8-2c6bbb6df999 with identifier: 19560308
2026-03-29 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96553639-abb3-5226-a7a8-2c6bbb6df999 with scrape type 1
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96553639-abb3-5226-a7a8-2c6bbb6df999
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_front_driver-1774707070461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_driver-1774707070461.jpg not downloaded yet
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20444990
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20184498
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20155249
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 14811957
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 4700757
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20492157
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20415455
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720415455%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [motorway.uk] INFO: Scrape type for 20415455: 1
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5589%252F20485589%252Fexterior_rear_passenger-1774700336639.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_rear_passenger-1774700336639.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1812%252F20481812%252Fexterior_rear_passenger-1774693226165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_rear_passenger-1774693226165.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_rear_passenger-1774784756882.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_passenger-1774784756882.jpg not downloaded yet
2026-03-29 20:15:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_rear_driver-1774707093261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_rear_driver-1774707093261.jpg not downloaded yet
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20465121
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465121%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [motorway.uk] INFO: Scrape type for 20465121: 1
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5589%252F20485589%252Finterior_front_seats-1774700701236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5589/20485589/interior_front_seats-1774700701236.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Finterior_front_seats-1774694216788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/interior_front_seats-1774694216788.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9918%252F9709918%252Finterior_front_seats-1774785293948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9918/9709918/interior_front_seats-1774785293948.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_front_passenger-1774707136590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_passenger-1774707136590.jpg not downloaded yet
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 19763259
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 20407866
2026-03-29 20:15:37 [motorway.uk] INFO: Found listing with ID: 19657268
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719657268%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [motorway.uk] INFO: Scrape type for 19657268: 1
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5589%252F20485589%252Finterior_rear_seats-1774700703932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5589/20485589/interior_rear_seats-1774700703932.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Finterior_rear_seats-1774694106551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/interior_rear_seats-1774694106551.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9918%252F9709918%252Finterior_rear_seats-1774785316868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9918/9709918/interior_rear_seats-1774785316868.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_rear_passenger-1774707113306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_rear_passenger-1774707113306.jpg not downloaded yet
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 4217945
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20421154
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20426599
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20483409
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20382764
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 17702324
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 19979923
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 7899191
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 9335437
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20443228
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 14132265
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 19384929
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719384929%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [motorway.uk] INFO: Scrape type for 19384929: 1
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5589%252F20485589%252Finterior_dashboard-1774701886550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5589/20485589/interior_dashboard-1774701886550.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1812%252F20481812%252F20481812-interior_dashboard-modified-1774694871347.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1812/20481812/20481812-interior_dashboard-modified-1774694871347.jpeg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Finterior_dashboard-1774785579080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/interior_dashboard-1774785579080.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0308%252F19560308%252Finterior_front_seats-1774707622878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0308/19560308/interior_front_seats-1774707622878.jpg not downloaded yet
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20385350
2026-03-29 20:15:38 [motorway.uk] INFO: Found listing with ID: 20231987
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5589%252F20485589%252Finstrument_cluster-1774700739955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5589/20485589/instrument_cluster-1774700739955.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Finterior_boot-1774694179060.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/interior_boot-1774694179060.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9918%252F9709918%252Finterior_boot-1774785397261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9918/9709918/interior_boot-1774785397261.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0308%252F19560308%252Finterior_rear_seats-1774707822502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0308/19560308/interior_rear_seats-1774707822502.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5589%252F20485589%252Finterior_boot-1774700708718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5589/20485589/interior_boot-1774700708718.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Fdamage_scratches-1774693344132.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693344132.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9918%252F9709918%252Fdocs_service_history-1774785754146.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc4b4b03665e051ffd5975251024e4886%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9918/9709918/docs_service_history-1774785754146.jpg?ixlib=js-3.8.0&auto=format&s=c4b4b03665e051ffd5975251024e4886 not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0308%252F19560308%252Finterior_dashboard-1774713766842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0308/19560308/interior_dashboard-1774713766842.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5589%252F20485589%252Fdocs_service_history-1774701849331.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D059c0472aeedd9aed966e1db51a5fe66%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5589/20485589/docs_service_history-1774701849331.jpg?ixlib=js-3.8.0&auto=format&s=059c0472aeedd9aed966e1db51a5fe66 not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Fdamage_scratches-1774693381779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693381779.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9918%252F9709918%252Fdocs_service_history-1774785754881.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D18c27ef0e7598a9326b3b1bfc8c0d819%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9918/9709918/docs_service_history-1774785754881.jpg?ixlib=js-3.8.0&auto=format&s=18c27ef0e7598a9326b3b1bfc8c0d819 not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Finstrument_cluster-1774707724950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/instrument_cluster-1774707724950.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0308%252F19560308%252Finterior_boot-1774707549463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0308/19560308/interior_boot-1774707549463.jpg not downloaded yet
2026-03-29 20:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20428242.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0308%252F19560308%252Fdocs_service_history-1774708587417.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8e1af1c40a44adf5df3039eb44af19ee%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0308/19560308/docs_service_history-1774708587417.jpg?ixlib=js-3.8.0&auto=format&s=8e1af1c40a44adf5df3039eb44af19ee not downloaded yet
2026-03-29 20:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_driver-1774700332686.jpg> (referer: None)
2026-03-29 20:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_driver-1774784713557.jpg> (referer: None)
2026-03-29 20:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_driver-1774693138420.jpg> (referer: None)
2026-03-29 20:15:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_front_driver-1774784737628.jpg> (referer: None)
2026-03-29 20:15:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dc7173c-81a7-537a-8c34-1ba7efc89633 with identifier: 20428242
2026-03-29 20:15:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 with scrape type 1
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dc7173c-81a7-537a-8c34-1ba7efc89633
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8242%252F20428242%252Fexterior_front_driver-1774456830331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_driver-1774456830331.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8242%252F20428242%252Fexterior_rear_driver-1774456828894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_driver-1774456828894.jpg not downloaded yet
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8242%252F20428242%252Fexterior_front_passenger-1774456855861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_passenger-1774456855861.jpg not downloaded yet
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec458d0>
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17ad40d-8a52-5b1f-b8ef-1e59f77bff32/e17ad40d-8a52-5b1f-b8ef-1e59f77bff32_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5589%252F20485589%252Fexterior_front_driver-1774700332686.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_driver-1774700332686.jpg saved to cache
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2acbd0>
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_rear_driver-1774784713557.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_driver-1774784713557.jpg saved to cache
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a6450>
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1812%252F20481812%252Fexterior_front_driver-1774693138420.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_driver-1774693138420.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d29d690>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_front_driver-1774784737628.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_front_driver-1774784737628.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8242%252F20428242%252Fexterior_rear_passenger-1774456835995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_passenger-1774456835995.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8242%252F20428242%252Finterior_front_seats-1774693437931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8242/20428242/interior_front_seats-1774693437931.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8242%252F20428242%252Finterior_rear_seats-1774693462816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8242/20428242/interior_rear_seats-1774693462816.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8242%252F20428242%252Finterior_dashboard-1774696806689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8242/20428242/interior_dashboard-1774696806689.jpg not downloaded yet
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8242%252F20428242%252Finterior_boot-1774693578131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8242/20428242/interior_boot-1774693578131.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8242%252F20428242%252Fdocs_service_history-1774694164099.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0fb29a05905f6a9336b45ccf37bec313%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8242/20428242/docs_service_history-1774694164099.jpg?ixlib=js-3.8.0&auto=format&s=0fb29a05905f6a9336b45ccf37bec313 not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8242%252F20428242%252Fdocs_service_history-1774695813149.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D871b5726f8318ff0741390e56c9439a4%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8242/20428242/docs_service_history-1774695813149.jpg?ixlib=js-3.8.0&auto=format&s=871b5726f8318ff0741390e56c9439a4 not downloaded yet
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_driver-1774707070461.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0308/19560308/instrument_cluster-1774707724950.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0308/19560308/interior_boot-1774707549463.jpg> (referer: None)
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca8a390>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_front_driver-1774707070461.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_driver-1774707070461.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96553639-abb3-5226-a7a8-2c6bbb6df999
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 96553639-abb3-5226-a7a8-2c6bbb6df999 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec6c390>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Finstrument_cluster-1774707724950.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/instrument_cluster-1774707724950.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96553639-abb3-5226-a7a8-2c6bbb6df999
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d116bd0>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0308%252F19560308%252Finterior_boot-1774707549463.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0308/19560308/interior_boot-1774707549463.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96553639-abb3-5226-a7a8-2c6bbb6df999
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_passenger-1774456835995.jpg> (referer: None)
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_passenger-1774456855861.jpg> (referer: None)
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693381779.jpg> (referer: None)
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d140b90>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dc7173c-81a7-537a-8c34-1ba7efc89633/8dc7173c-81a7-537a-8c34-1ba7efc89633_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8242%252F20428242%252Fexterior_rear_passenger-1774456835995.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_passenger-1774456835995.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e7d10>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dc7173c-81a7-537a-8c34-1ba7efc89633/8dc7173c-81a7-537a-8c34-1ba7efc89633_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8242%252F20428242%252Fexterior_front_passenger-1774456855861.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_passenger-1774456855861.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2982d0>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Fdamage_scratches-1774693381779.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693381779.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8242/20428242/interior_boot-1774693578131.jpg> (referer: None)
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d741390>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dc7173c-81a7-537a-8c34-1ba7efc89633/8dc7173c-81a7-537a-8c34-1ba7efc89633_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8242%252F20428242%252Finterior_boot-1774693578131.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8242/20428242/interior_boot-1774693578131.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18288929.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5589/20485589/instrument_cluster-1774700739955.jpg> (referer: None)
2026-03-29 20:15:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73de9341-12f2-57bf-8f88-0655e318407f with identifier: 18288929
2026-03-29 20:15:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73de9341-12f2-57bf-8f88-0655e318407f with scrape type 1
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_front_driver-1774524511219.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_driver-1774524511219.jpeg not downloaded yet
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_rear_driver-1774524535591.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_driver-1774524535591.jpeg not downloaded yet
2026-03-29 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693344132.jpg> (referer: None)
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_front_passenger-1774524512518.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_passenger-1774524512518.jpeg not downloaded yet
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_rear_passenger-1774524524107.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_passenger-1774524524107.jpeg not downloaded yet
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8929%252F18288929%252F18288929-interior_front_seats-modified-1774688531748.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8929/18288929/18288929-interior_front_seats-modified-1774688531748.jpeg not downloaded yet
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca53b90>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17ad40d-8a52-5b1f-b8ef-1e59f77bff32/e17ad40d-8a52-5b1f-b8ef-1e59f77bff32_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5589%252F20485589%252Finstrument_cluster-1774700739955.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5589/20485589/instrument_cluster-1774700739955.jpg saved to cache
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8929%252F18288929%252Finterior_rear_seats-1774525018373.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg not downloaded yet
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Finterior_dashboard-1774525080317.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/interior_dashboard-1774525080317.jpeg not downloaded yet
2026-03-29 20:15:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec74090>
2026-03-29 20:15:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Fdamage_scratches-1774693344132.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693344132.jpg saved to cache
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8dc7173c-81a7-537a-8c34-1ba7efc89633 with identifier: 20428242
2026-03-29 20:15:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8dc7173c-81a7-537a-8c34-1ba7efc89633 with identifier: 20428242
2026-03-29 20:15:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8dc7173c-81a7-537a-8c34-1ba7efc89633 with identifier: 20428242 to the API
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:41 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '8dc7173c-81a7-537a-8c34-1ba7efc89633',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL22 MUO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20428242',
'listing': 'auction',
'location': 'Essex Maldon',
'make': 'Fiat',
'model': '500E',
'odometer': 24936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_driver-1774456830331.jpg',
'https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_driver-1774456828894.jpg',
'https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_passenger-1774456855861.jpg',
'https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_passenger-1774456835995.jpg',
'https://motorway-photos.imgix.net/8242/20428242/interior_front_seats-1774693437931.jpg',
'https://motorway-photos.imgix.net/8242/20428242/interior_rear_seats-1774693462816.jpg',
'https://motorway-photos-modified.imgix.net/8242/20428242/interior_dashboard-1774696806689.jpg',
'https://motorway-photos.imgix.net/8242/20428242/interior_boot-1774693578131.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8242/20428242/docs_service_history-1774694164099.jpg?ixlib=js-3.8.0&auto=format&s=0fb29a05905f6a9336b45ccf37bec313',
'https://motorway-service-history-photos.imgix.net/modified/8242/20428242/docs_service_history-1774695813149.jpg?ixlib=js-3.8.0&auto=format&s=871b5726f8318ff0741390e56c9439a4'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc7173c-81a7-537a-8c34-1ba7efc89633/8dc7173c-81a7-537a-8c34-1ba7efc89633_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682315,
'Height': 2182,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_front_passenger-1774456855861.jpg',
'Width': 2909},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc7173c-81a7-537a-8c34-1ba7efc89633/8dc7173c-81a7-537a-8c34-1ba7efc89633_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1230875,
'Height': 2236,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8242/20428242/exterior_rear_passenger-1774456835995.jpg',
'Width': 2981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dc7173c-81a7-537a-8c34-1ba7efc89633/8dc7173c-81a7-537a-8c34-1ba7efc89633_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2158731,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8242/20428242/interior_boot-1774693578131.jpg',
'Width': 4032}],
'price': 12035,
'price_includes_vat': False,
'registration_date': '2022-03-23',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500E LA Prima',
'transmission': 'automatic',
'trim': 'LA Prima',
'vin': 'ZFAEFAJ47NX064893',
'year': 2022}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428242%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [motorway.uk] INFO: Saving data for 20428242: {'created_time': 1774815341.816101, 'last_price_update_time': 1774815341.816111, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20428242') HTTP/1.1" 204 0
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8929%252F18288929%252F18288929-instrument_cluster-modified-1774629942192.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8929/18288929/18288929-instrument_cluster-modified-1774629942192.jpeg not downloaded yet
2026-03-29 20:15:41 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14322154) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg>.
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 8dc7173c-81a7-537a-8c34-1ba7efc89633 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8929%252F18288929%252Finterior_boot-1774525452796.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg not downloaded yet
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8929%252F18288929%252Fdocs_service_history-1774525671523.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D212de9111c67dea5edc04436d36e166b%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8929/18288929/docs_service_history-1774525671523.jpeg?ixlib=js-3.8.0&auto=format&s=212de9111c67dea5edc04436d36e166b not downloaded yet
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=108&page=3&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 96553639-abb3-5226-a7a8-2c6bbb6df999 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 96553639-abb3-5226-a7a8-2c6bbb6df999 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 96553639-abb3-5226-a7a8-2c6bbb6df999 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9918/9709918/interior_boot-1774785397261.jpg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_passenger-1774524512518.jpeg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12346509) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg>.
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20449304
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 17481408
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20476083
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476083%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20476083: 1
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20450250
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450250%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20450250: 1
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20443071
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443071%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20443071: 0
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20263862
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720263862%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20263862: 1
2026-03-29 20:15:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:15:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca9ad10>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9918%252F9709918%252Finterior_boot-1774785397261.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9918/9709918/interior_boot-1774785397261.jpg saved to cache
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20476478
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20477592
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 19952830
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 19845582
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20485961
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 19583490
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719583490%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 19583490: 1
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d129b10>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_front_passenger-1774524512518.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_passenger-1774524512518.jpeg saved to cache
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20485937
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20431432
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20420321
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 19097531
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20491041
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 15524366
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715524366%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 15524366: 1
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20382551
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382551%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20382551: 1
2026-03-29 20:15:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20477418
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20305532
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 18763419
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 17680882
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 8876821
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20413933
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 11696787
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20136196
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720136196%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20136196: 1
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20500894
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20411106
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411106%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20411106: 1
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 18971390
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718971390%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 18971390: 1
2026-03-29 20:15:42 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg>.
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20311155
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20401199
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 16449198
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20386812
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20464629
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 13048174
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713048174%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 13048174: 1
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_driver-1774524535591.jpeg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8929/18288929/interior_dashboard-1774525080317.jpeg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg>.
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg> (referer: None)
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2dc310>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_rear_driver-1774524535591.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_driver-1774524535591.jpeg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19478931.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d301450>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Finterior_dashboard-1774525080317.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/interior_dashboard-1774525080317.jpeg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xd2hQ\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08!\x99\x00\xd2^]\x00\x00\x00\x00'
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d159e10>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8929%252F18288929%252Finterior_rear_seats-1774525018373.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb3R\xab\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\x11\xe2\x00\xb3H\xb7\x00\x00\x00\x00'
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e012f10>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8929%252F18288929%252Finterior_boot-1774525452796.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 73de9341-12f2-57bf-8f88-0655e318407f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 73de9341-12f2-57bf-8f88-0655e318407f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 73de9341-12f2-57bf-8f88-0655e318407f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_passenger-1774524524107.jpeg> (referer: None)
2026-03-29 20:15:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 with identifier: 19478931
2026-03-29 20:15:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 with scrape type 1
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_front_driver-1774708837390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_front_driver-1774708837390.jpg not downloaded yet
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_rear_driver-1774708674665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_driver-1774708674665.jpg not downloaded yet
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_front_passenger-1774708977598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_front_passenger-1774708977598.jpg not downloaded yet
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_rear_passenger-1774708848672.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_passenger-1774708848672.jpg not downloaded yet
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8931%252F19478931%252Finterior_front_seats-1774709479095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8931/19478931/interior_front_seats-1774709479095.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8931%252F19478931%252Finterior_rear_seats-1774709538669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8931/19478931/interior_rear_seats-1774709538669.jpg not downloaded yet
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05ee90>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8929%252F18288929%252Fexterior_rear_passenger-1774524524107.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_passenger-1774524524107.jpeg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73de9341-12f2-57bf-8f88-0655e318407f
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Finterior_dashboard-1774709642495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/interior_dashboard-1774709642495.jpg not downloaded yet
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20479276.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Finstrument_cluster-1774709550148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/instrument_cluster-1774709550148.jpg not downloaded yet
2026-03-29 20:15:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8931%252F19478931%252Finterior_boot-1774709693322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8931/19478931/interior_boot-1774709693322.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8931%252F19478931%252Fdocs_service_history-1774719400987.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac0cfe6ab437e316453c2823b49e47dc%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8931/19478931/docs_service_history-1774719400987.jpg?ixlib=js-3.8.0&auto=format&s=ac0cfe6ab437e316453c2823b49e47dc not downloaded yet
2026-03-29 20:15:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623ecb1b-5694-537a-9cfd-77a52cb482cb with identifier: 20479276
2026-03-29 20:15:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623ecb1b-5694-537a-9cfd-77a52cb482cb with scrape type 1
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 623ecb1b-5694-537a-9cfd-77a52cb482cb
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_front_driver-1774698758974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_driver-1774698758974.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_rear_driver-1774698772258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_driver-1774698772258.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_front_passenger-1774698824566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_passenger-1774698824566.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_rear_passenger-1774698805872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_passenger-1774698805872.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9276%252F20479276%252Finterior_front_seats-1774699113275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9276/20479276/interior_front_seats-1774699113275.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9276%252F20479276%252Finterior_rear_seats-1774699189326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9276/20479276/interior_rear_seats-1774699189326.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9276%252F20479276%252Finterior_dashboard-1774709388204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9276/20479276/interior_dashboard-1774709388204.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Finstrument_cluster-1774699199812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/instrument_cluster-1774699199812.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9276%252F20479276%252Finterior_boot-1774699163854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9276/20479276/interior_boot-1774699163854.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9276%252F20479276%252Fdocs_service_history-1774701036356.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2e49d26a834565141a5ed0e167c635a0%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9276/20479276/docs_service_history-1774701036356.jpg?ixlib=js-3.8.0&auto=format&s=2e49d26a834565141a5ed0e167c635a0 not downloaded yet
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15524366.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8931/19478931/interior_dashboard-1774709642495.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8931/19478931/interior_rear_seats-1774709538669.jpg> (referer: None)
2026-03-29 20:15:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5770ffef-4e0d-518d-8cd1-a45ab52561a9 with identifier: 15524366
2026-03-29 20:15:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 with scrape type 1
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_front_driver-1774095125196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_driver-1774095125196.jpg not downloaded yet
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_rear_driver-1774095068366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_driver-1774095068366.jpg not downloaded yet
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_front_passenger-1774095041878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_passenger-1774095041878.jpg not downloaded yet
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced5610>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Finterior_dashboard-1774709642495.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/interior_dashboard-1774709642495.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3f88d0>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8931%252F19478931%252Finterior_rear_seats-1774709538669.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8931/19478931/interior_rear_seats-1774709538669.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_rear_passenger-1774094973864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_passenger-1774094973864.jpg not downloaded yet
2026-03-29 20:15:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73de9341-12f2-57bf-8f88-0655e318407f with identifier: 18288929
2026-03-29 20:15:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73de9341-12f2-57bf-8f88-0655e318407f with identifier: 18288929
2026-03-29 20:15:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73de9341-12f2-57bf-8f88-0655e318407f with identifier: 18288929 to the API
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:45 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '73de9341-12f2-57bf-8f88-0655e318407f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV19 KXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18288929',
'listing': 'auction',
'location': 'Greater Manchester Oldham',
'make': 'BMW',
'model': 'X5',
'odometer': 45775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_driver-1774524511219.jpeg',
'https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_driver-1774524535591.jpeg',
'https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_passenger-1774524512518.jpeg',
'https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_passenger-1774524524107.jpeg',
'https://motorway-photos-modified.imgix.net/8929/18288929/18288929-interior_front_seats-modified-1774688531748.jpeg',
'https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg',
'https://motorway-photos-redacted.imgix.net/8929/18288929/interior_dashboard-1774525080317.jpeg',
'https://motorway-photos-modified.imgix.net/8929/18288929/18288929-instrument_cluster-modified-1774629942192.jpeg',
'https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8929/18288929/docs_service_history-1774525671523.jpeg?ixlib=js-3.8.0&auto=format&s=212de9111c67dea5edc04436d36e166b'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5742869,
'Height': 5123,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_driver-1774524535591.jpeg',
'Width': 6830},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7141990,
'Height': 5624,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_front_passenger-1774524512518.jpeg',
'Width': 7499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7324242,
'Height': 5906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8929/18288929/exterior_rear_passenger-1774524524107.jpeg',
'Width': 7875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14322154,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8929/18288929/interior_rear_seats-1774525018373.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5842198,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8929/18288929/interior_dashboard-1774525080317.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73de9341-12f2-57bf-8f88-0655e318407f/73de9341-12f2-57bf-8f88-0655e318407f_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12346509,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8929/18288929/interior_boot-1774525452796.jpeg',
'Width': 8064}],
'price': 36651,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'BMW X5 M50D Auto',
'transmission': 'automatic',
'trim': 'M50D Auto',
'vin': 'WBACV02020LP64911',
'year': 2019}
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718288929%27 HTTP/1.1" 200 None
2026-03-29 20:15:45 [motorway.uk] INFO: Saving data for 18288929: {'created_time': 1774815345.847068, 'last_price_update_time': 1774815345.847081, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18288929') HTTP/1.1" 204 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4366%252F15524366%252Finterior_front_seats-1774095921229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4366/15524366/interior_front_seats-1774095921229.jpg not downloaded yet
2026-03-29 20:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=144&page=4&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 73de9341-12f2-57bf-8f88-0655e318407f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4366%252F15524366%252Finterior_rear_seats-1774095582313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4366/15524366/interior_rear_seats-1774095582313.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4366%252F15524366%252Finterior_dashboard-1774104345753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4366/15524366/interior_dashboard-1774104345753.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4366%252F15524366%252Finterior_boot-1774095505600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4366/15524366/interior_boot-1774095505600.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4366%252F15524366%252Fdocs_service_history-1774695581838.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc29b47151b855ad76dab039f6f6c9024%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4366/15524366/docs_service_history-1774695581838.jpg?ixlib=js-3.8.0&auto=format&s=c29b47151b855ad76dab039f6f6c9024 not downloaded yet
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4366%252F15524366%252Fdocs_service_history-1774695606996.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D23ccc84c7e125459956bb37d8a24cb0a%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4366/15524366/docs_service_history-1774695606996.jpg?ixlib=js-3.8.0&auto=format&s=23ccc84c7e125459956bb37d8a24cb0a not downloaded yet
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20490005
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490005%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 20490005: 1
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 6813303
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20443922
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20487361
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487361%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 20487361: 1
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20363550
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 9266502
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19877308
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 17678385
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20457330
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 10427170
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20496977
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496977%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 20496977: 1
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20251350
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20431049
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20500887
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20491991
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19662517
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719662517%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 19662517: 1
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_driver-1774095125196.jpg> (referer: None)
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20437069
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720437069%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 20437069: 1
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20439564
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 3925743
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20473314
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473314%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 20473314: 1
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19289424
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 13901334
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19716040
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19665928
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20477540
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20488894
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20392952
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20448956
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 4497838
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274497838%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 4497838: 1
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_driver-1774095068366.jpg> (referer: None)
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18971390.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20408834
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20494023
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19574622
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719574622%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 19574622: 1
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_passenger-1774094973864.jpg> (referer: None)
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20483061
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 20487257
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487257%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 20487257: 1
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_passenger-1774095041878.jpg> (referer: None)
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 19110205
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719110205%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Scrape type for 19110205: 1
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a62d0>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_front_driver-1774095125196.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_driver-1774095125196.jpg saved to cache
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:15:46 [motorway.uk] INFO: Found listing with ID: 7326413
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec45f50>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_rear_driver-1774095068366.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_driver-1774095068366.jpg saved to cache
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:15:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 with identifier: 18971390
2026-03-29 20:15:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 with scrape type 1
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fexterior_front_driver-1774691744027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_front_driver-1774691744027.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fexterior_rear_driver-1774691752196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_driver-1774691752196.jpg not downloaded yet
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d73e250>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_rear_passenger-1774094973864.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_passenger-1774094973864.jpg saved to cache
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d29ec10>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4366%252F15524366%252Fexterior_front_passenger-1774095041878.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_passenger-1774095041878.jpg saved to cache
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fexterior_front_passenger-1774691753661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_front_passenger-1774691753661.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fexterior_rear_passenger-1774691755381.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_passenger-1774691755381.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1390%252F18971390%252Finterior_front_seats-1774691489450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1390/18971390/interior_front_seats-1774691489450.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1390%252F18971390%252Finterior_rear_seats-1774691432364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1390/18971390/interior_rear_seats-1774691432364.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1390%252F18971390%252Finterior_dashboard-1774695024607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1390/18971390/interior_dashboard-1774695024607.jpg not downloaded yet
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20411106.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1390%252F18971390%252Finterior_boot-1774691464797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1390/18971390/interior_boot-1774691464797.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1390%252F18971390%252Fdocs_service_history-1774691673823.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1fb49c0651f2c638b6d3778d57e062f%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1390/18971390/docs_service_history-1774691673823.jpg?ixlib=js-3.8.0&auto=format&s=d1fb49c0651f2c638b6d3778d57e062f not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fwheels_front_driver-1774691747216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/wheels_front_driver-1774691747216.jpg not downloaded yet
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9276/20479276/interior_boot-1774699163854.jpg> (referer: None)
2026-03-29 20:15:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e35aef-e7ee-5beb-96da-3067b3511f10 with identifier: 20411106
2026-03-29 20:15:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e35aef-e7ee-5beb-96da-3067b3511f10 with scrape type 1
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95e35aef-e7ee-5beb-96da-3067b3511f10
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Fexterior_front_driver-1774707874170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_front_driver-1774707874170.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Fexterior_rear_driver-1774707837251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_rear_driver-1774707837251.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Fexterior_front_passenger-1774707870170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_front_passenger-1774707870170.jpg not downloaded yet
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Fexterior_rear_passenger-1774707872490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_rear_passenger-1774707872490.jpg not downloaded yet
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d739490>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9276%252F20479276%252Finterior_boot-1774699163854.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9276/20479276/interior_boot-1774699163854.jpg saved to cache
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1106%252F20411106%252Finterior_front_seats-1774708631551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1106/20411106/interior_front_seats-1774708631551.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1106%252F20411106%252Finterior_rear_seats-1774708629339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1106/20411106/interior_rear_seats-1774708629339.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Finterior_dashboard-1774708640879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/interior_dashboard-1774708640879.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Finstrument_cluster-1774708537957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/instrument_cluster-1774708537957.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1106%252F20411106%252Finterior_boot-1774708655690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1106/20411106/interior_boot-1774708655690.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1106%252F20411106%252Fdocs_service_history-1774709177494.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D291e15f9376f959c04296fd90bbe6c61%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1106/20411106/docs_service_history-1774709177494.jpg?ixlib=js-3.8.0&auto=format&s=291e15f9376f959c04296fd90bbe6c61 not downloaded yet
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1390/18971390/wheels_front_driver-1774691747216.jpg> (referer: None)
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1390/18971390/interior_rear_seats-1774691432364.jpg> (referer: None)
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22ffd0>
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1b12e-3c4e-5742-a54f-98b5cf397d25/7dc1b12e-3c4e-5742-a54f-98b5cf397d25_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fwheels_front_driver-1774691747216.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/wheels_front_driver-1774691747216.jpg saved to cache
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca8bc90>
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1b12e-3c4e-5742-a54f-98b5cf397d25/7dc1b12e-3c4e-5742-a54f-98b5cf397d25_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1390%252F18971390%252Finterior_rear_seats-1774691432364.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1390/18971390/interior_rear_seats-1774691432364.jpg saved to cache
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20136196.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13048174.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69b60480-088e-5f8f-a766-540f5e7891ad with identifier: 20136196
2026-03-29 20:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69b60480-088e-5f8f-a766-540f5e7891ad with scrape type 1
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_front_driver-1774706916889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_driver-1774706916889.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_rear_driver-1774706915955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_rear_driver-1774706915955.jpg not downloaded yet
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19583490.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_front_passenger-1774706918411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_passenger-1774706918411.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_rear_passenger-1774706919325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_rear_passenger-1774706919325.jpg not downloaded yet
2026-03-29 20:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29615c5b-8f80-5d8d-93d4-23516e47d314 with identifier: 13048174
2026-03-29 20:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29615c5b-8f80-5d8d-93d4-23516e47d314 with scrape type 1
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29615c5b-8f80-5d8d-93d4-23516e47d314
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Fexterior_front_driver-1774692829337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_front_driver-1774692829337.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20136196%252Finterior_front_seats-1774707333531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20136196/interior_front_seats-1774707333531.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Fexterior_rear_driver-1774692847701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_driver-1774692847701.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20136196%252Finterior_rear_seats-1774707305282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20136196/interior_rear_seats-1774707305282.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Fexterior_front_passenger-1774692872744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_front_passenger-1774692872744.jpg not downloaded yet
2026-03-29 20:15:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 with identifier: 19583490
2026-03-29 20:15:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 with scrape type 1
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_front_driver-1773931957100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_driver-1773931957100.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6196%252F20136196%252Finterior_dashboard-1774774420884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6196/20136196/interior_dashboard-1774774420884.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Fexterior_rear_passenger-1774692857473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_passenger-1774692857473.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_rear_driver-1773931968960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_driver-1773931968960.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Finstrument_cluster-1774707359468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/instrument_cluster-1774707359468.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8174%252F13048174%252Finterior_front_seats-1774693272343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8174/13048174/interior_front_seats-1774693272343.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_front_passenger-1773931998564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_passenger-1773931998564.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20136196%252Finterior_boot-1774707307865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20136196/interior_boot-1774707307865.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8174%252F13048174%252Finterior_rear_seats-1774693389599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8174/13048174/interior_rear_seats-1774693389599.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_rear_passenger-1773931984300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_passenger-1773931984300.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6196%252F20136196%252Fdocs_service_history-1774707628758.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da99b4835a8e6723a6c07a6ee34f23894%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6196/20136196/docs_service_history-1774707628758.jpg?ixlib=js-3.8.0&auto=format&s=a99b4835a8e6723a6c07a6ee34f23894 not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Finterior_dashboard-1774693328383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/interior_dashboard-1774693328383.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F19583490%252Finterior_front_seats-1773932425725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/19583490/interior_front_seats-1773932425725.jpg not downloaded yet
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1106/20411106/instrument_cluster-1774708537957.jpg> (referer: None)
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8174%252F13048174%252Finterior_boot-1774693362227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8174/13048174/interior_boot-1774693362227.jpg not downloaded yet
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F19583490%252Finterior_rear_seats-1773932446886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/19583490/interior_rear_seats-1773932446886.jpg not downloaded yet
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1106/20411106/interior_dashboard-1774708640879.jpg> (referer: None)
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8174%252F13048174%252Fdocs_service_history-1774694790458.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd521222017c676536f5d50d91f652672%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8174/13048174/docs_service_history-1774694790458.jpg?ixlib=js-3.8.0&auto=format&s=d521222017c676536f5d50d91f652672 not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Finterior_dashboard-1773932350152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/interior_dashboard-1773932350152.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8174%252F13048174%252Fdocs_service_history-1774694810151.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db0aae80f83b96838ccc5781733da0b39%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8174/13048174/docs_service_history-1774694810151.jpg?ixlib=js-3.8.0&auto=format&s=b0aae80f83b96838ccc5781733da0b39 not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Finstrument_cluster-1773932376816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/instrument_cluster-1773932376816.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F19583490%252Finterior_boot-1773936344874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/19583490/interior_boot-1773936344874.jpg not downloaded yet
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c667fd0>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e35aef-e7ee-5beb-96da-3067b3511f10/95e35aef-e7ee-5beb-96da-3067b3511f10_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Finstrument_cluster-1774708537957.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/instrument_cluster-1774708537957.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95e35aef-e7ee-5beb-96da-3067b3511f10
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1106/20411106/interior_boot-1774708655690.jpg> (referer: None)
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3490%252F19583490%252Fdocs_service_history-1774189798281.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D09859873450c641253c853e232fa1536%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3490/19583490/docs_service_history-1774189798281.jpg?ixlib=js-3.8.0&auto=format&s=09859873450c641253c853e232fa1536 not downloaded yet
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d261e10>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e35aef-e7ee-5beb-96da-3067b3511f10/95e35aef-e7ee-5beb-96da-3067b3511f10_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1106%252F20411106%252Finterior_dashboard-1774708640879.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1106/20411106/interior_dashboard-1774708640879.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95e35aef-e7ee-5beb-96da-3067b3511f10
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_driver-1774706916889.jpg> (referer: None)
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b2450>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95e35aef-e7ee-5beb-96da-3067b3511f10/95e35aef-e7ee-5beb-96da-3067b3511f10_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1106%252F20411106%252Finterior_boot-1774708655690.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1106/20411106/interior_boot-1774708655690.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95e35aef-e7ee-5beb-96da-3067b3511f10
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b22d0>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_front_driver-1774706916889.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_driver-1774706916889.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19601663.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_passenger-1773931998564.jpg> (referer: None)
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8174/13048174/interior_dashboard-1774693328383.jpg> (referer: None)
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3490/19583490/interior_rear_seats-1773932446886.jpg> (referer: None)
2026-03-29 20:15:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27ccea0-4efc-5762-903a-dd6c84437a26 with identifier: 19601663
2026-03-29 20:15:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27ccea0-4efc-5762-903a-dd6c84437a26 with scrape type 1
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a27ccea0-4efc-5762-903a-dd6c84437a26
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1663%252F19601663%252Fexterior_front_driver-1773941829041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1663/19601663/exterior_front_driver-1773941829041.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1663%252F19601663%252Fexterior_rear_driver-1773937294337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_rear_driver-1773937294337.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1663%252F19601663%252Fexterior_front_passenger-1773937239284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_front_passenger-1773937239284.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1663%252F19601663%252Fexterior_rear_passenger-1773937267281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_rear_passenger-1773937267281.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1663%252F19601663%252Finterior_front_seats-1773941863138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1663/19601663/interior_front_seats-1773941863138.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1663%252F19601663%252Finterior_rear_seats-1773938154740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1663/19601663/interior_rear_seats-1773938154740.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1663%252F19601663%252Finterior_dashboard-1773941814585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1663/19601663/interior_dashboard-1773941814585.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1663%252F19601663%252Finterior_boot-1773941725729.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1663/19601663/interior_boot-1773941725729.jpg already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1663%252F19601663%252Fdocs_service_history-1773938735273.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c570ec8e759bcfc8c5bd76fe7af39b4%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1663/19601663/docs_service_history-1773938735273.jpg?ixlib=js-3.8.0&auto=format&s=8c570ec8e759bcfc8c5bd76fe7af39b4 already downloaded
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1663%252F19601663%252Fdamage_scratches-1773937506567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1663/19601663/damage_scratches-1773937506567.jpg already downloaded
2026-03-29 20:15:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a27ccea0-4efc-5762-903a-dd6c84437a26, identifier: 19601663
2026-03-29 20:15:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a27ccea0-4efc-5762-903a-dd6c84437a26 with identifier: 19601663
2026-03-29 20:15:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a27ccea0-4efc-5762-903a-dd6c84437a26 with identifier: 19601663
2026-03-29 20:15:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a27ccea0-4efc-5762-903a-dd6c84437a26 with identifier: 19601663 to the API
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19601663.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a27ccea0-4efc-5762-903a-dd6c84437a26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OW17 GUE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19601663',
'listing': 'auction',
'location': 'Greater London Stanmore',
'make': 'Honda',
'model': 'CR-V',
'odometer': 49000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-modified.imgix.net/1663/19601663/exterior_front_driver-1773941829041.jpg',
'https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_rear_driver-1773937294337.jpg',
'https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_front_passenger-1773937239284.jpg',
'https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_rear_passenger-1773937267281.jpg',
'https://motorway-photos-modified.imgix.net/1663/19601663/interior_front_seats-1773941863138.jpg',
'https://motorway-photos.imgix.net/1663/19601663/interior_rear_seats-1773938154740.jpg',
'https://motorway-photos-modified.imgix.net/1663/19601663/interior_dashboard-1773941814585.jpg',
'https://motorway-photos.imgix.net/1663/19601663/interior_boot-1773941725729.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1663/19601663/docs_service_history-1773938735273.jpg?ixlib=js-3.8.0&auto=format&s=8c570ec8e759bcfc8c5bd76fe7af39b4',
'https://motorway-photos.imgix.net/1663/19601663/damage_scratches-1773937506567.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1536519,
'Height': 2534,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1663/19601663/exterior_front_driver-1773941829041.jpg',
'Width': 3379},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1041707,
'Height': 2515,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_rear_driver-1773937294337.jpg',
'Width': 3353},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1081385,
'Height': 2331,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_front_passenger-1773937239284.jpg',
'Width': 3108},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1307653,
'Height': 2518,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1663/19601663/exterior_rear_passenger-1773937267281.jpg',
'Width': 3357},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2529380,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1663/19601663/interior_front_seats-1773941863138.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2413743,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1663/19601663/interior_rear_seats-1773938154740.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1567273,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1663/19601663/interior_dashboard-1773941814585.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187725,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/1663/19601663/interior_boot-1773941725729.jpg',
'Width': 810},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691858,
'Height': 1607,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1663/19601663/docs_service_history-1773938735273.jpg?ixlib=js-3.8.0&auto=format&s=8c570ec8e759bcfc8c5bd76fe7af39b4',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27ccea0-4efc-5762-903a-dd6c84437a26/a27ccea0-4efc-5762-903a-dd6c84437a26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3103287,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1663/19601663/damage_scratches-1773937506567.jpg',
'Width': 4032}],
'price': 12247,
'price_includes_vat': False,
'registration_date': '2017-06-20',
'seats_number': None,
'seller_name': None,
'title': 'Honda CR-V SR I-VTEC Auto',
'transmission': 'automatic',
'trim': 'SR I-VTEC Auto',
'vin': 'SHSRE5870GU008557',
'year': 2017}
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719601663%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Saving data for 19601663: {'created_time': 1774815350.033021, 'last_price_update_time': 1774815350.033032, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19601663') HTTP/1.1" 204 0
2026-03-29 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20263862.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b7450>
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_front_passenger-1773931998564.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_passenger-1773931998564.jpg saved to cache
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d178750>
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29615c5b-8f80-5d8d-93d4-23516e47d314/29615c5b-8f80-5d8d-93d4-23516e47d314_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Finterior_dashboard-1774693328383.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/interior_dashboard-1774693328383.jpg saved to cache
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29615c5b-8f80-5d8d-93d4-23516e47d314
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d058cd0>
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F19583490%252Finterior_rear_seats-1773932446886.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/19583490/interior_rear_seats-1773932446886.jpg saved to cache
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20450250.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e073863-df7e-592f-9820-941d60aa919c with identifier: 20263862
2026-03-29 20:15:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e073863-df7e-592f-9820-941d60aa919c with scrape type 1
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_front_driver-1774718982078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_driver-1774718982078.jpg not downloaded yet
2026-03-29 20:15:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_rear_driver-1774718934980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_driver-1774718934980.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_front_passenger-1774719109366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_passenger-1774719109366.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_rear_passenger-1774719068102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_passenger-1774719068102.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3862%252F20263862%252Finterior_front_seats-1774719949023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3862/20263862/interior_front_seats-1774719949023.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3862%252F20263862%252Finterior_rear_seats-1774719790748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3862/20263862/interior_rear_seats-1774719790748.jpg not downloaded yet
2026-03-29 20:15:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130ce3ed-43b8-541a-92e2-d909d7e4876f with identifier: 20450250
2026-03-29 20:15:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130ce3ed-43b8-541a-92e2-d909d7e4876f with scrape type 1
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 130ce3ed-43b8-541a-92e2-d909d7e4876f
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0250%252F20450250%252Fexterior_front_driver-1774541617115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0250/20450250/exterior_front_driver-1774541617115.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Finterior_dashboard-1774719890053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/interior_dashboard-1774719890053.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0250%252F20450250%252Fexterior_rear_driver-1774692168793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0250/20450250/exterior_rear_driver-1774692168793.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Finstrument_cluster-1774719793359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/instrument_cluster-1774719793359.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0250%252F20450250%252Fexterior_front_passenger-1774773884300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0250/20450250/exterior_front_passenger-1774773884300.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3862%252F20263862%252Finterior_boot-1774719990423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3862/20263862/interior_boot-1774719990423.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0250%252F20450250%252Fexterior_rear_passenger-1774773929663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0250/20450250/exterior_rear_passenger-1774773929663.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3862%252F20263862%252Fdocs_service_history-1774720079364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0577e7c760c7fb0a87069eede204f2f5%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3862/20263862/docs_service_history-1774720079364.jpg?ixlib=js-3.8.0&auto=format&s=0577e7c760c7fb0a87069eede204f2f5 not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0250%252F20450250%252Finterior_front_seats-1774542100323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0250/20450250/interior_front_seats-1774542100323.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0250%252F20450250%252Finterior_rear_seats-1774542084858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0250/20450250/interior_rear_seats-1774542084858.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0250%252F20450250%252Finterior_dashboard-1774542115693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0250/20450250/interior_dashboard-1774542115693.jpg not downloaded yet
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_passenger-1773931984300.jpg> (referer: None)
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0250%252F20450250%252Finterior_boot-1774542092502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0250/20450250/interior_boot-1774542092502.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0250%252F20450250%252Fdocs_service_history-1774691249659.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1bd926bd673a5d9f5d0472782eec93c4%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0250/20450250/docs_service_history-1774691249659.jpg?ixlib=js-3.8.0&auto=format&s=1bd926bd673a5d9f5d0472782eec93c4 not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0250%252F20450250%252Fdocs_service_history-1774691263287.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44b309885034a8646b67d7dac0c1a1db%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0250/20450250/docs_service_history-1774691263287.jpg?ixlib=js-3.8.0&auto=format&s=44b309885034a8646b67d7dac0c1a1db not downloaded yet
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/19583490/instrument_cluster-1773932376816.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3490/19583490/interior_boot-1773936344874.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/19583490/interior_dashboard-1773932350152.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8174/13048174/interior_boot-1774693362227.jpg> (referer: None)
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2b9b90>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_rear_passenger-1773931984300.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_passenger-1773931984300.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2bae90>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Finstrument_cluster-1773932376816.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/instrument_cluster-1773932376816.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e087650>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F19583490%252Finterior_boot-1773936344874.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/19583490/interior_boot-1773936344874.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c659510>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Finterior_dashboard-1773932350152.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/interior_dashboard-1773932350152.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e08d990>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29615c5b-8f80-5d8d-93d4-23516e47d314/29615c5b-8f80-5d8d-93d4-23516e47d314_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8174%252F13048174%252Finterior_boot-1774693362227.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8174/13048174/interior_boot-1774693362227.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29615c5b-8f80-5d8d-93d4-23516e47d314
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0250/20450250/interior_dashboard-1774542115693.jpg> (referer: None)
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 69b60480-088e-5f8f-a766-540f5e7891ad due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca29d10>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0250%252F20450250%252Finterior_dashboard-1774542115693.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0250/20450250/interior_dashboard-1774542115693.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0250/20450250/interior_boot-1774542092502.jpg> (referer: None)
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0250/20450250/interior_rear_seats-1774542084858.jpg> (referer: None)
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d270510>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0250%252F20450250%252Finterior_boot-1774542092502.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0250/20450250/interior_boot-1774542092502.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e016310>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0250%252F20450250%252Finterior_rear_seats-1774542084858.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0250/20450250/interior_rear_seats-1774542084858.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3862/20263862/instrument_cluster-1774719793359.jpg> (referer: None)
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54ebd0>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Finstrument_cluster-1774719793359.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/instrument_cluster-1774719793359.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3862/20263862/interior_dashboard-1774719890053.jpg> (referer: None)
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2adf50>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Finterior_dashboard-1774719890053.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/interior_dashboard-1774719890053.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7e073863-df7e-592f-9820-941d60aa919c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7e073863-df7e-592f-9820-941d60aa919c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0250/20450250/exterior_front_driver-1774541617115.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_passenger-1774719109366.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_driver-1774718934980.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3862/20263862/interior_front_seats-1774719949023.jpg> (referer: None)
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea5d2d0>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0250%252F20450250%252Fexterior_front_driver-1774541617115.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0250/20450250/exterior_front_driver-1774541617115.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0331d0>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_front_passenger-1774719109366.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_passenger-1774719109366.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca5d9d0>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_rear_driver-1774718934980.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_driver-1774718934980.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d73d410>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3862%252F20263862%252Finterior_front_seats-1774719949023.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3862/20263862/interior_front_seats-1774719949023.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_passenger-1774719068102.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3862/20263862/interior_rear_seats-1774719790748.jpg> (referer: None)
2026-03-29 20:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 130ce3ed-43b8-541a-92e2-d909d7e4876f with identifier: 20450250
2026-03-29 20:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 130ce3ed-43b8-541a-92e2-d909d7e4876f with identifier: 20450250
2026-03-29 20:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 130ce3ed-43b8-541a-92e2-d909d7e4876f with identifier: 20450250 to the API
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:54 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '130ce3ed-43b8-541a-92e2-d909d7e4876f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'P90 WAT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20450250',
'listing': 'auction',
'location': 'Highland Council Thurso',
'make': 'Audi',
'model': 'SQ5',
'odometer': 32289,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0250/20450250/exterior_front_driver-1774541617115.jpg',
'https://motorway-photos-modified.imgix.net/0250/20450250/exterior_rear_driver-1774692168793.jpg',
'https://motorway-photos-modified.imgix.net/0250/20450250/exterior_front_passenger-1774773884300.jpg',
'https://motorway-photos-modified.imgix.net/0250/20450250/exterior_rear_passenger-1774773929663.jpg',
'https://motorway-photos.imgix.net/0250/20450250/interior_front_seats-1774542100323.jpg',
'https://motorway-photos.imgix.net/0250/20450250/interior_rear_seats-1774542084858.jpg',
'https://motorway-photos-redacted.imgix.net/0250/20450250/interior_dashboard-1774542115693.jpg',
'https://motorway-photos.imgix.net/0250/20450250/interior_boot-1774542092502.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/0250/20450250/docs_service_history-1774691249659.jpg?ixlib=js-3.8.0&auto=format&s=1bd926bd673a5d9f5d0472782eec93c4',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/0250/20450250/docs_service_history-1774691263287.jpg?ixlib=js-3.8.0&auto=format&s=44b309885034a8646b67d7dac0c1a1db'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1241690,
'Height': 2095,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0250/20450250/exterior_front_driver-1774541617115.jpg',
'Width': 2793},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1897548,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0250/20450250/interior_rear_seats-1774542084858.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1643587,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0250/20450250/interior_dashboard-1774542115693.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_130ce3ed-43b8-541a-92e2-d909d7e4876f/130ce3ed-43b8-541a-92e2-d909d7e4876f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2793665,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0250/20450250/interior_boot-1774542092502.jpg',
'Width': 3840}],
'price': 37326,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seats_number': None,
'seller_name': None,
'title': 'Audi SQ5 TDI MHEV Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI MHEV Quattro Auto',
'vin': 'WAUZZZFY7N2034976',
'year': 2021}
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450250%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [motorway.uk] INFO: Saving data for 20450250: {'created_time': 1774815354.590799, 'last_price_update_time': 1774815354.590811, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20450250') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 130ce3ed-43b8-541a-92e2-d909d7e4876f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2efed0>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3862%252F20263862%252Fexterior_rear_passenger-1774719068102.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_passenger-1774719068102.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f07a50>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3862%252F20263862%252Finterior_rear_seats-1774719790748.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3862/20263862/interior_rear_seats-1774719790748.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e073863-df7e-592f-9820-941d60aa919c
2026-03-29 20:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7e073863-df7e-592f-9820-941d60aa919c with identifier: 20263862
2026-03-29 20:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7e073863-df7e-592f-9820-941d60aa919c with identifier: 20263862
2026-03-29 20:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7e073863-df7e-592f-9820-941d60aa919c with identifier: 20263862 to the API
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:55 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7e073863-df7e-592f-9820-941d60aa919c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN69 NNW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20263862',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Jaguar',
'model': 'E-PACE',
'odometer': 60000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_driver-1774718982078.jpg',
'https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_driver-1774718934980.jpg',
'https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_passenger-1774719109366.jpg',
'https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_passenger-1774719068102.jpg',
'https://motorway-photos.imgix.net/3862/20263862/interior_front_seats-1774719949023.jpg',
'https://motorway-photos.imgix.net/3862/20263862/interior_rear_seats-1774719790748.jpg',
'https://motorway-photos-redacted.imgix.net/3862/20263862/interior_dashboard-1774719890053.jpg',
'https://motorway-photos-redacted.imgix.net/3862/20263862/instrument_cluster-1774719793359.jpg',
'https://motorway-photos.imgix.net/3862/20263862/interior_boot-1774719990423.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/3862/20263862/docs_service_history-1774720079364.jpg?ixlib=js-3.8.0&auto=format&s=0577e7c760c7fb0a87069eede204f2f5'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1480672,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_driver-1774718934980.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1298380,
'Height': 2154,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_front_passenger-1774719109366.jpg',
'Width': 2872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1732097,
'Height': 2684,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3862/20263862/exterior_rear_passenger-1774719068102.jpg',
'Width': 3579},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3139897,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3862/20263862/interior_front_seats-1774719949023.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2733129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3862/20263862/interior_rear_seats-1774719790748.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2445586,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3862/20263862/interior_dashboard-1774719890053.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e073863-df7e-592f-9820-941d60aa919c/7e073863-df7e-592f-9820-941d60aa919c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173637,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3862/20263862/instrument_cluster-1774719793359.jpg',
'Width': 4032}],
'price': 12855,
'price_includes_vat': False,
'registration_date': '2019-10-16',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar E-PACE Chequered Flag D AWD A',
'transmission': 'automatic',
'trim': 'Chequered Flag D AWD A',
'vin': 'SADFA2AN9L1Z81512',
'year': 2019}
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720263862%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [motorway.uk] INFO: Saving data for 20263862: {'created_time': 1774815355.316257, 'last_price_update_time': 1774815355.316268, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20263862') HTTP/1.1" 204 0
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 69b60480-088e-5f8f-a766-540f5e7891ad due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20382551.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19662517.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7e073863-df7e-592f-9820-941d60aa919c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_passenger-1774692857473.jpg> (referer: None)
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20437069.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_driver-1773931968960.jpg> (referer: None)
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_driver-1773931957100.jpg> (referer: None)
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6196/20136196/instrument_cluster-1774707359468.jpg> (referer: None)
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6196/20136196/interior_rear_seats-1774707305282.jpg> (referer: None)
2026-03-29 20:15:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d9d163-23cc-5783-be2c-8c9f92256796 with identifier: 20382551
2026-03-29 20:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d9d163-23cc-5783-be2c-8c9f92256796 with scrape type 1
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03d9d163-23cc-5783-be2c-8c9f92256796
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Fexterior_front_driver-1774527845111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/exterior_front_driver-1774527845111.jpg not downloaded yet
2026-03-29 20:15:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28eaded-0231-5035-a550-1357380b079b with identifier: 19662517
2026-03-29 20:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28eaded-0231-5035-a550-1357380b079b with scrape type 1
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c28eaded-0231-5035-a550-1357380b079b
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2517%252F19662517%252Fexterior_front_driver-1770542558703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_front_driver-1770542558703.jpg not downloaded yet
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Fexterior_rear_driver-1774527876100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/exterior_rear_driver-1774527876100.jpg not downloaded yet
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2517%252F19662517%252Fexterior_rear_driver-1770541170235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_rear_driver-1770541170235.jpg not downloaded yet
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 69b60480-088e-5f8f-a766-540f5e7891ad due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Fexterior_front_passenger-1774527916191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/exterior_front_passenger-1774527916191.jpg not downloaded yet
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2517%252F19662517%252Fexterior_front_passenger-1770541232477.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_front_passenger-1770541232477.jpg not downloaded yet
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2b8e90>
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29615c5b-8f80-5d8d-93d4-23516e47d314/29615c5b-8f80-5d8d-93d4-23516e47d314_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8174%252F13048174%252Fexterior_rear_passenger-1774692857473.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_passenger-1774692857473.jpg saved to cache
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29615c5b-8f80-5d8d-93d4-23516e47d314
2026-03-29 20:15:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f with identifier: 20437069
2026-03-29 20:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f with scrape type 1
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_front_driver-1774515048058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_driver-1774515048058.jpg not downloaded yet
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce9ef90>
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_rear_driver-1773931968960.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_driver-1773931968960.jpg saved to cache
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce9ef90>
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F19583490%252Fexterior_front_driver-1773931957100.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_driver-1773931957100.jpg saved to cache
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11
2026-03-29 20:15:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11, skipping ID generation
2026-03-29 20:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 with scrape type 1
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 sending to next pipeline
2026-03-29 20:15:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11, identifier: 19583490
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e084890>
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Finstrument_cluster-1774707359468.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/instrument_cluster-1774707359468.jpg saved to cache
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca67290>
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20136196%252Finterior_rear_seats-1774707305282.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20136196/interior_rear_seats-1774707305282.jpg saved to cache
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 with identifier: 19583490
2026-03-29 20:15:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 with identifier: 19583490
2026-03-29 20:15:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9c809b84-d8d6-5896-9d7e-67ed8ffb8e11 with identifier: 19583490 to the API
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_driver-1773931957100.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9c809b84-d8d6-5896-9d7e-67ed8ffb8e11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML19 UYR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19583490',
'listing': 'auction',
'location': 'Derbyshire Swadlincote',
'make': 'Audi',
'model': 'A1',
'odometer': 29000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 881704,
'Height': 1877,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_driver-1773931957100.jpg',
'Width': 2503},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1096052,
'Height': 2215,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_driver-1773931968960.jpg',
'Width': 2953},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1176353,
'Height': 2216,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_front_passenger-1773931998564.jpg',
'Width': 2954},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 794643,
'Height': 1858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/19583490/exterior_rear_passenger-1773931984300.jpg',
'Width': 2477},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4719099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3490/19583490/interior_rear_seats-1773932446886.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136804,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/19583490/interior_dashboard-1773932350152.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2608983,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/19583490/instrument_cluster-1773932376816.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c809b84-d8d6-5896-9d7e-67ed8ffb8e11/9c809b84-d8d6-5896-9d7e-67ed8ffb8e11_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3294879,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3490/19583490/interior_boot-1773936344874.jpg',
'Width': 4032}],
'price': 12191,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport 35 TFSI',
'transmission': 'manual',
'trim': 'Sport 35 TFSI',
'vin': 'WAUZZZGB1KR029995',
'year': 2019}
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719583490%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [motorway.uk] INFO: Saving data for 19583490: {'created_time': 1774815356.831594, 'last_price_update_time': 1774815356.831606, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19583490') HTTP/1.1" 204 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Fexterior_rear_passenger-1774527895767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/exterior_rear_passenger-1774527895767.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2517%252F19662517%252Fexterior_rear_passenger-1770542600698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_rear_passenger-1770542600698.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_rear_driver-1774515045700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_rear_driver-1774515045700.jpg not downloaded yet
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19874916.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20476083.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2551%252F20382551%252Finterior_front_seats-1774535376743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2551/20382551/interior_front_seats-1774535376743.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2517%252F19662517%252Finterior_front_seats-1770541539219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2517/19662517/interior_front_seats-1770541539219.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_front_passenger-1774515143597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_passenger-1774515143597.jpg not downloaded yet
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2551%252F20382551%252Finterior_rear_seats-1774535543043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2551/20382551/interior_rear_seats-1774535543043.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2517%252F19662517%252Finterior_rear_seats-1770541551829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2517/19662517/interior_rear_seats-1770541551829.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_rear_passenger-1774515041394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_rear_passenger-1774515041394.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Finterior_dashboard-1774535441844.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/interior_dashboard-1774535441844.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2517%252F19662517%252Finterior_dashboard-1774694568427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2517/19662517/interior_dashboard-1774694568427.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7069%252F20437069%252Finterior_front_seats-1774726328932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7069/20437069/interior_front_seats-1774726328932.jpg not downloaded yet
2026-03-29 20:15:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 29615c5b-8f80-5d8d-93d4-23516e47d314 with identifier: 13048174
2026-03-29 20:15:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 29615c5b-8f80-5d8d-93d4-23516e47d314 with identifier: 13048174
2026-03-29 20:15:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 29615c5b-8f80-5d8d-93d4-23516e47d314 with identifier: 13048174 to the API
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:57 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '29615c5b-8f80-5d8d-93d4-23516e47d314',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK22 UJW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13048174',
'listing': 'auction',
'location': 'Leicestershire Market Harborough',
'make': 'Audi',
'model': 'S4',
'odometer': 43278,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_front_driver-1774692829337.jpg',
'https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_driver-1774692847701.jpg',
'https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_front_passenger-1774692872744.jpg',
'https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_passenger-1774692857473.jpg',
'https://motorway-photos.imgix.net/8174/13048174/interior_front_seats-1774693272343.jpg',
'https://motorway-photos.imgix.net/8174/13048174/interior_rear_seats-1774693389599.jpg',
'https://motorway-photos-redacted.imgix.net/8174/13048174/interior_dashboard-1774693328383.jpg',
'https://motorway-photos.imgix.net/8174/13048174/interior_boot-1774693362227.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8174/13048174/docs_service_history-1774694790458.jpg?ixlib=js-3.8.0&auto=format&s=d521222017c676536f5d50d91f652672',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8174/13048174/docs_service_history-1774694810151.jpg?ixlib=js-3.8.0&auto=format&s=b0aae80f83b96838ccc5781733da0b39'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29615c5b-8f80-5d8d-93d4-23516e47d314/29615c5b-8f80-5d8d-93d4-23516e47d314_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300255,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8174/13048174/exterior_rear_passenger-1774692857473.jpg',
'Width': 3383},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29615c5b-8f80-5d8d-93d4-23516e47d314/29615c5b-8f80-5d8d-93d4-23516e47d314_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1629683,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8174/13048174/interior_dashboard-1774693328383.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29615c5b-8f80-5d8d-93d4-23516e47d314/29615c5b-8f80-5d8d-93d4-23516e47d314_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3971144,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8174/13048174/interior_boot-1774693362227.jpg',
'Width': 4032}],
'price': 32032,
'price_includes_vat': False,
'registration_date': '2022-04-15',
'seats_number': None,
'seller_name': None,
'title': 'Audi S4 TDI MHEV Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI MHEV Quattro Auto',
'vin': 'WAUZZZF47NA037377',
'year': 2022}
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713048174%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [motorway.uk] INFO: Saving data for 13048174: {'created_time': 1774815357.557059, 'last_price_update_time': 1774815357.55707, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13048174') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 69b60480-088e-5f8f-a766-540f5e7891ad due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 29615c5b-8f80-5d8d-93d4-23516e47d314 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Finstrument_cluster-1774535467034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/instrument_cluster-1774535467034.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2517%252F19662517%252Finstrument_cluster-1770542613194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2517/19662517/instrument_cluster-1770542613194.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7069%252F20437069%252Finterior_rear_seats-1774721753579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7069/20437069/interior_rear_seats-1774721753579.jpg not downloaded yet
2026-03-29 20:15:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 with identifier: 19874916
2026-03-29 20:15:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 with scrape type 1
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7efdf3d4-2727-5af9-b5d0-3c2370f08e37
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F19874916%252Fexterior_front_driver-1773159995884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_front_driver-1773159995884.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F19874916%252Fexterior_rear_driver-1773160010621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_rear_driver-1773160010621.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F19874916%252Fexterior_front_passenger-1773160061762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_front_passenger-1773160061762.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F19874916%252Fexterior_rear_passenger-1773160030292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_rear_passenger-1773160030292.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F19874916%252Finterior_front_seats-1773324997097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/19874916/interior_front_seats-1773324997097.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F19874916%252Finterior_rear_seats-1773325008150.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/19874916/interior_rear_seats-1773325008150.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F19874916%252Finterior_dashboard-1773325013884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/19874916/interior_dashboard-1773325013884.jpg already downloaded
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F19874916%252Finstrument_cluster-1773325073844.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/19874916/instrument_cluster-1773325073844.jpg not downloaded yet
2026-03-29 20:15:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 with identifier: 20476083
2026-03-29 20:15:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 with scrape type 1
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_front_driver-1774781345497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_driver-1774781345497.jpg not downloaded yet
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473314.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2551%252F20382551%252Finterior_boot-1774777325740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2551/20382551/interior_boot-1774777325740.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2517%252F19662517%252Finterior_boot-1770542596081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2517/19662517/interior_boot-1770542596081.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Finterior_dashboard-1774721363901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/interior_dashboard-1774721363901.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F19874916%252Finterior_boot-1773325020832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/19874916/interior_boot-1773325020832.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_rear_driver-1774779580327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_driver-1774779580327.jpg not downloaded yet
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4497838.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2551%252F20382551%252Fdocs_service_history-1774708685489.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7f9036bd5977c1129e347d7af69309f4%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2551/20382551/docs_service_history-1774708685489.jpg?ixlib=js-3.8.0&auto=format&s=7f9036bd5977c1129e347d7af69309f4 not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2517%252F19662517%252Fwheels_front_driver-1770541288869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2517/19662517/wheels_front_driver-1770541288869.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Finstrument_cluster-1774726500248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/instrument_cluster-1774726500248.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4916%252F19874916%252Fdocs_service_history-1773325434325.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dea0fc0aa48376138670fe2a70b0af385%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4916/19874916/docs_service_history-1773325434325.jpg?ixlib=js-3.8.0&auto=format&s=ea0fc0aa48376138670fe2a70b0af385 already downloaded
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_front_passenger-1774779617431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_passenger-1774779617431.jpg not downloaded yet
2026-03-29 20:15:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc430c46-26b0-53cd-b276-c96c82cbdc68 with identifier: 20473314
2026-03-29 20:15:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc430c46-26b0-53cd-b276-c96c82cbdc68 with scrape type 1
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_front_driver-1774699458549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_driver-1774699458549.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7069%252F20437069%252Finterior_boot-1774721293509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7069/20437069/interior_boot-1774721293509.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_rear_passenger-1774779596058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_passenger-1774779596058.jpg not downloaded yet
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_passenger-1774706918411.jpg> (referer: None)
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_rear_driver-1774699427976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_driver-1774699427976.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7069%252F20437069%252Fdamage_scratches-1774515198318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7069/20437069/damage_scratches-1774515198318.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6083%252F20476083%252Finterior_front_seats-1774780505303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6083/20476083/interior_front_seats-1774780505303.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_front_passenger-1774699454932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_passenger-1774699454932.jpg not downloaded yet
2026-03-29 20:15:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 255875a2-4875-5ff4-a0d1-eed61f092f40 with identifier: 4497838
2026-03-29 20:15:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255875a2-4875-5ff4-a0d1-eed61f092f40 with scrape type 1
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 255875a2-4875-5ff4-a0d1-eed61f092f40
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F4497838%252Fexterior_front_driver-1767273536734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_front_driver-1767273536734.jpg not downloaded yet
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6083%252F20476083%252Finterior_rear_seats-1774780574526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6083/20476083/interior_rear_seats-1774780574526.jpg not downloaded yet
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19574622.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_rear_passenger-1774699440750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_passenger-1774699440750.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F4497838%252Fexterior_rear_driver-1767273554406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_rear_driver-1767273554406.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Finterior_dashboard-1774780659786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/interior_dashboard-1774780659786.jpg not downloaded yet
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3293d0>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_front_passenger-1774706918411.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_passenger-1774706918411.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3314%252F20473314%252Finterior_front_seats-1774700384698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3314/20473314/interior_front_seats-1774700384698.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F4497838%252Fexterior_front_passenger-1767273544463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_front_passenger-1767273544463.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Finstrument_cluster-1774780987406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/instrument_cluster-1774780987406.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3314%252F20473314%252Finterior_rear_seats-1774700422376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3314/20473314/interior_rear_seats-1774700422376.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F4497838%252Fexterior_rear_passenger-1767273554269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_rear_passenger-1767273554269.jpg not downloaded yet
2026-03-29 20:15:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06755544-986b-5fdc-8657-1801267d105d with identifier: 19574622
2026-03-29 20:15:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06755544-986b-5fdc-8657-1801267d105d with scrape type 1
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06755544-986b-5fdc-8657-1801267d105d
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4622%252F19574622%252Fexterior_front_driver-1770386363652.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_driver-1770386363652.jpeg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6083%252F20476083%252Finterior_boot-1774780842505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6083/20476083/interior_boot-1774780842505.jpg not downloaded yet
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_rear_driver-1774706915955.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_driver-1774515048058.jpg> (referer: None)
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Finterior_dashboard-1774700475824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/interior_dashboard-1774700475824.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F4497838%252Finterior_front_seats-1767274137568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/4497838/interior_front_seats-1767274137568.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4622%252F19574622%252Fexterior_rear_driver-1770386401182.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_driver-1770386401182.jpeg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6083%252F20476083%252Fdocs_service_history-1774781079984.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc191fd65b6199f4bbfe35ab64e4a7e94%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6083/20476083/docs_service_history-1774781079984.jpg?ixlib=js-3.8.0&auto=format&s=c191fd65b6199f4bbfe35ab64e4a7e94 not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Finstrument_cluster-1774700487748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/instrument_cluster-1774700487748.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F4497838%252Finterior_rear_seats-1767273900000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/4497838/interior_rear_seats-1767273900000.jpg not downloaded yet
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4622%252F19574622%252Fexterior_front_passenger-1770386378712.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_passenger-1770386378712.jpeg not downloaded yet
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6196/20136196/interior_front_seats-1774707333531.jpg> (referer: None)
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e921510>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20136196%252Fexterior_rear_driver-1774706915955.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_rear_driver-1774706915955.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb96150>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_front_driver-1774515048058.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_driver-1774515048058.jpg saved to cache
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3314%252F20473314%252Finterior_boot-1774700478540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3314/20473314/interior_boot-1774700478540.jpg not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7838%252F4497838%252Finterior_dashboard-1774780674469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7838/4497838/interior_dashboard-1774780674469.jpg not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4622%252F19574622%252Fexterior_rear_passenger-1770386390370.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_passenger-1770386390370.jpeg not downloaded yet
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_front_passenger-1770541232477.jpg> (referer: None)
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3314%252F20473314%252Fdocs_service_history-1774700605705.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D755028a412f12e6a71adf5a9e8116846%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3314/20473314/docs_service_history-1774700605705.jpg?ixlib=js-3.8.0&auto=format&s=755028a412f12e6a71adf5a9e8116846 not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7838%252F4497838%252Finstrument_cluster-1774780650642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7838/4497838/instrument_cluster-1774780650642.jpg not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4622%252F19574622%252Finterior_front_seats-1770386557489.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4622/19574622/interior_front_seats-1770386557489.jpeg not downloaded yet
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e927550>
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20136196%252Finterior_front_seats-1774707333531.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20136196/interior_front_seats-1774707333531.jpg saved to cache
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69b60480-088e-5f8f-a766-540f5e7891ad
2026-03-29 20:15:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69b60480-088e-5f8f-a766-540f5e7891ad, skipping ID generation
2026-03-29 20:15:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69b60480-088e-5f8f-a766-540f5e7891ad with scrape type 1
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69b60480-088e-5f8f-a766-540f5e7891ad sending to next pipeline
2026-03-29 20:15:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 69b60480-088e-5f8f-a766-540f5e7891ad, identifier: 20136196
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F4497838%252Finterior_boot-1767274115534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/4497838/interior_boot-1767274115534.jpg not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4622%252F19574622%252Finterior_rear_seats-1770386751427.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4622/19574622/interior_rear_seats-1770386751427.jpeg not downloaded yet
2026-03-29 20:15:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 69b60480-088e-5f8f-a766-540f5e7891ad with identifier: 20136196
2026-03-29 20:15:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 69b60480-088e-5f8f-a766-540f5e7891ad with identifier: 20136196
2026-03-29 20:15:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 69b60480-088e-5f8f-a766-540f5e7891ad with identifier: 20136196 to the API
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6196/20136196/interior_front_seats-1774707333531.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '69b60480-088e-5f8f-a766-540f5e7891ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO68 WYX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20136196',
'listing': 'auction',
'location': 'Surrey Walton-on-Thames',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 36100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1465767,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_driver-1774706916889.jpg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1742973,
'Height': 2750,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_rear_driver-1774706915955.jpg',
'Width': 3667},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1075147,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6196/20136196/exterior_front_passenger-1774706918411.jpg',
'Width': 3302},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1905988,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/6196/20136196/interior_front_seats-1774707333531.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2822654,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/6196/20136196/interior_rear_seats-1774707305282.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69b60480-088e-5f8f-a766-540f5e7891ad/69b60480-088e-5f8f-a766-540f5e7891ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1379758,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6196/20136196/instrument_cluster-1774707359468.jpg',
'Width': 3840}],
'price': 9117,
'price_includes_vat': False,
'registration_date': '2018-12-06',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE EVO',
'transmission': 'manual',
'trim': 'SE EVO',
'vin': 'WVWZZZAWZKU012273',
'year': 2018}
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720136196%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [motorway.uk] INFO: Saving data for 20136196: {'created_time': 1774815359.832865, 'last_price_update_time': 1774815359.832878, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20136196') HTTP/1.1" 204 0
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7838%252F4497838%252Fdocs_service_history-1767276746873.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a353b6f46ca19879397cf7342ead650%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7838/4497838/docs_service_history-1767276746873.jpg?ixlib=js-3.8.0&auto=format&s=6a353b6f46ca19879397cf7342ead650 not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4622%252F19574622%252F19574622-interior_dashboard-modified-1770387531761.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4622/19574622/19574622-interior_dashboard-modified-1770387531761.jpeg not downloaded yet
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2dc10>
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28eaded-0231-5035-a550-1357380b079b/c28eaded-0231-5035-a550-1357380b079b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2517%252F19662517%252Fexterior_front_passenger-1770541232477.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_front_passenger-1770541232477.jpg saved to cache
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c28eaded-0231-5035-a550-1357380b079b
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4622%252F19574622%252F19574622-instrument_cluster-modified-1770387567470.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4622/19574622/19574622-instrument_cluster-modified-1770387567470.jpeg not downloaded yet
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4622%252F19574622%252F19574622-interior_boot-modified-1770387557425.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4622/19574622/19574622-interior_boot-modified-1770387557425.jpeg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4622%252F19574622%252F19574622-docs_service_history-default-1770388045923.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2692e38ad58d33b8f3d26016d9e2213d%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4622/19574622/19574622-docs_service_history-default-1770388045923.png?ixlib=js-3.8.0&auto=format&s=2692e38ad58d33b8f3d26016d9e2213d not downloaded yet
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_driver-1774699458549.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_driver-1774779580327.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_passenger-1774779617431.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_driver-1774781345497.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6083/20476083/interior_rear_seats-1774780574526.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3314/20473314/interior_boot-1774700478540.jpg> (referer: None)
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed61e50>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_front_driver-1774699458549.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_driver-1774699458549.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca69710>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_rear_driver-1774779580327.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_driver-1774779580327.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e038d90>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_front_passenger-1774779617431.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_passenger-1774779617431.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07d450>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6083%252F20476083%252Fexterior_front_driver-1774781345497.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_driver-1774781345497.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed63850>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6083%252F20476083%252Finterior_rear_seats-1774780574526.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6083/20476083/interior_rear_seats-1774780574526.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebf6810>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3314%252F20473314%252Finterior_boot-1774700478540.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3314/20473314/interior_boot-1774700478540.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 255875a2-4875-5ff4-a0d1-eed61f092f40 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item dc430c46-26b0-53cd-b276-c96c82cbdc68 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 255875a2-4875-5ff4-a0d1-eed61f092f40 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 255875a2-4875-5ff4-a0d1-eed61f092f40 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7838/4497838/interior_boot-1767274115534.jpg> (referer: None)
2026-03-29 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3314/20473314/interior_dashboard-1774700475824.jpg> (referer: None)
2026-03-29 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3314/20473314/instrument_cluster-1774700487748.jpg> (referer: None)
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23c890>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F4497838%252Finterior_boot-1767274115534.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/4497838/interior_boot-1767274115534.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 255875a2-4875-5ff4-a0d1-eed61f092f40
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad38d0>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Finterior_dashboard-1774700475824.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/interior_dashboard-1774700475824.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e921610>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Finstrument_cluster-1774700487748.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/instrument_cluster-1774700487748.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_driver-1770386401182.jpeg> (referer: None)
2026-03-29 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_driver-1770386363652.jpeg> (referer: None)
2026-03-29 20:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7838/4497838/interior_front_seats-1767274137568.jpg> (referer: None)
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3c650>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06755544-986b-5fdc-8657-1801267d105d/06755544-986b-5fdc-8657-1801267d105d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4622%252F19574622%252Fexterior_rear_driver-1770386401182.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_driver-1770386401182.jpeg saved to cache
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06755544-986b-5fdc-8657-1801267d105d
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebf4610>
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06755544-986b-5fdc-8657-1801267d105d/06755544-986b-5fdc-8657-1801267d105d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4622%252F19574622%252Fexterior_front_driver-1770386363652.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_driver-1770386363652.jpeg saved to cache
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06755544-986b-5fdc-8657-1801267d105d
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca73810>
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F4497838%252Finterior_front_seats-1767274137568.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/4497838/interior_front_seats-1767274137568.jpg saved to cache
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 255875a2-4875-5ff4-a0d1-eed61f092f40
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 255875a2-4875-5ff4-a0d1-eed61f092f40 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 06755544-986b-5fdc-8657-1801267d105d with identifier: 19574622
2026-03-29 20:16:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 06755544-986b-5fdc-8657-1801267d105d with identifier: 19574622
2026-03-29 20:16:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 06755544-986b-5fdc-8657-1801267d105d with identifier: 19574622 to the API
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:02 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '06755544-986b-5fdc-8657-1801267d105d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': '51 LG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19574622',
'listing': 'auction',
'location': 'None Stirling',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 23000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_driver-1770386363652.jpeg',
'https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_driver-1770386401182.jpeg',
'https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_passenger-1770386378712.jpeg',
'https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_passenger-1770386390370.jpeg',
'https://motorway-photos.imgix.net/4622/19574622/interior_front_seats-1770386557489.jpeg',
'https://motorway-photos.imgix.net/4622/19574622/interior_rear_seats-1770386751427.jpeg',
'https://motorway-photos-modified.imgix.net/4622/19574622/19574622-interior_dashboard-modified-1770387531761.jpeg',
'https://motorway-photos-modified.imgix.net/4622/19574622/19574622-instrument_cluster-modified-1770387567470.jpeg',
'https://motorway-photos-modified.imgix.net/4622/19574622/19574622-interior_boot-modified-1770387557425.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/4622/19574622/19574622-docs_service_history-default-1770388045923.png?ixlib=js-3.8.0&auto=format&s=2692e38ad58d33b8f3d26016d9e2213d'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06755544-986b-5fdc-8657-1801267d105d/06755544-986b-5fdc-8657-1801267d105d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849647,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_front_driver-1770386363652.jpeg',
'Width': 3507},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06755544-986b-5fdc-8657-1801267d105d/06755544-986b-5fdc-8657-1801267d105d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1718730,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4622/19574622/exterior_rear_driver-1770386401182.jpeg',
'Width': 3443}],
'price': 46225,
'price_includes_vat': False,
'registration_date': '2022-09-02',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery R-DYNAM HSE D MHEV A',
'transmission': 'automatic',
'trim': 'R-DYNAM HSE D MHEV A',
'vin': 'SALRA2AW2P2471416',
'year': 2022}
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719574622%27 HTTP/1.1" 200 None
2026-03-29 20:16:02 [motorway.uk] INFO: Saving data for 19574622: {'created_time': 1774815362.785576, 'last_price_update_time': 1774815362.785585, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19574622') HTTP/1.1" 204 0
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 255875a2-4875-5ff4-a0d1-eed61f092f40 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item dc430c46-26b0-53cd-b276-c96c82cbdc68 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 06755544-986b-5fdc-8657-1801267d105d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 255875a2-4875-5ff4-a0d1-eed61f092f40 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item dc430c46-26b0-53cd-b276-c96c82cbdc68 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_rear_driver-1767273554406.jpg> (referer: None)
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_passenger-1774699440750.jpg> (referer: None)
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7069/20437069/damage_scratches-1774515198318.jpg> (referer: None)
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_passenger-1774699454932.jpg> (referer: None)
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_front_driver-1767273536734.jpg> (referer: None)
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6083/20476083/interior_front_seats-1774780505303.jpg> (referer: None)
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2bb10>
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F4497838%252Fexterior_rear_driver-1767273554406.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_rear_driver-1767273554406.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 255875a2-4875-5ff4-a0d1-eed61f092f40
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d37cb50>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_rear_passenger-1774699440750.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_passenger-1774699440750.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d144e90>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7069%252F20437069%252Fdamage_scratches-1774515198318.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7069/20437069/damage_scratches-1774515198318.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e038a50>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3314%252F20473314%252Fexterior_front_passenger-1774699454932.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_passenger-1774699454932.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc430c46-26b0-53cd-b276-c96c82cbdc68
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb95510>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F4497838%252Fexterior_front_driver-1767273536734.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_front_driver-1767273536734.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 255875a2-4875-5ff4-a0d1-eed61f092f40
2026-03-29 20:16:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 255875a2-4875-5ff4-a0d1-eed61f092f40, skipping ID generation
2026-03-29 20:16:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255875a2-4875-5ff4-a0d1-eed61f092f40 with scrape type 1
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 255875a2-4875-5ff4-a0d1-eed61f092f40 sending to next pipeline
2026-03-29 20:16:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 255875a2-4875-5ff4-a0d1-eed61f092f40, identifier: 4497838
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d742a90>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6083%252F20476083%252Finterior_front_seats-1774780505303.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6083/20476083/interior_front_seats-1774780505303.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2
2026-03-29 20:16:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 255875a2-4875-5ff4-a0d1-eed61f092f40 with identifier: 4497838
2026-03-29 20:16:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 255875a2-4875-5ff4-a0d1-eed61f092f40 with identifier: 4497838
2026-03-29 20:16:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 255875a2-4875-5ff4-a0d1-eed61f092f40 with identifier: 4497838 to the API
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_front_driver-1767273536734.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '255875a2-4875-5ff4-a0d1-eed61f092f40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM68 OBL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4497838',
'listing': 'auction',
'location': 'Essex Harlow',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 68000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2504810,
'Height': 2920,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_front_driver-1767273536734.jpg',
'Width': 3893},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1592823,
'Height': 2386,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7838/4497838/exterior_rear_driver-1767273554406.jpg',
'Width': 3181},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4301359,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7838/4497838/interior_front_seats-1767274137568.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255875a2-4875-5ff4-a0d1-eed61f092f40/255875a2-4875-5ff4-a0d1-eed61f092f40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5274079,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7838/4497838/interior_boot-1767274115534.jpg',
'Width': 4032}],
'price': 23768,
'price_includes_vat': False,
'registration_date': '2018-11-21',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Touareg V6 R-LINE Tech TDI A',
'transmission': 'automatic',
'trim': 'V6 R-LINE Tech TDI A',
'vin': 'WVGZZZCRZKD003752',
'year': 2018}
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274497838%27 HTTP/1.1" 200 None
2026-03-29 20:16:04 [motorway.uk] INFO: Saving data for 4497838: {'created_time': 1774815364.129378, 'last_price_update_time': 1774815364.12939, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4497838') HTTP/1.1" 204 0
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2551/20382551/instrument_cluster-1774535467034.jpg> (referer: None)
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 with identifier: 20476083
2026-03-29 20:16:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 with identifier: 20476083
2026-03-29 20:16:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 with identifier: 20476083 to the API
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:04 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '7e5b24b3-94b4-53a2-88d3-969ed013ebf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG71 EBM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20476083',
'listing': 'auction',
'location': 'Devon Exeter',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 33837,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_driver-1774781345497.jpg',
'https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_driver-1774779580327.jpg',
'https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_passenger-1774779617431.jpg',
'https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_passenger-1774779596058.jpg',
'https://motorway-photos.imgix.net/6083/20476083/interior_front_seats-1774780505303.jpg',
'https://motorway-photos.imgix.net/6083/20476083/interior_rear_seats-1774780574526.jpg',
'https://motorway-photos-redacted.imgix.net/6083/20476083/interior_dashboard-1774780659786.jpg',
'https://motorway-photos-redacted.imgix.net/6083/20476083/instrument_cluster-1774780987406.jpg',
'https://motorway-photos.imgix.net/6083/20476083/interior_boot-1774780842505.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/6083/20476083/docs_service_history-1774781079984.jpg?ixlib=js-3.8.0&auto=format&s=c191fd65b6199f4bbfe35ab64e4a7e94'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2490099,
'Height': 2941,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_driver-1774781345497.jpg',
'Width': 3921},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1417959,
'Height': 2344,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_rear_driver-1774779580327.jpg',
'Width': 3125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1498235,
'Height': 2503,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6083/20476083/exterior_front_passenger-1774779617431.jpg',
'Width': 3337},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3261873,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6083/20476083/interior_front_seats-1774780505303.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5b24b3-94b4-53a2-88d3-969ed013ebf2/7e5b24b3-94b4-53a2-88d3-969ed013ebf2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3403133,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6083/20476083/interior_rear_seats-1774780574526.jpg',
'Width': 4032}],
'price': 11443,
'price_includes_vat': False,
'registration_date': '2021-11-11',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Kona Premium EV',
'transmission': 'automatic',
'trim': 'Premium EV',
'vin': 'KMHK381GUNU143370',
'year': 2021}
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476083%27 HTTP/1.1" 200 None
2026-03-29 20:16:04 [motorway.uk] INFO: Saving data for 20476083: {'created_time': 1774815364.709796, 'last_price_update_time': 1774815364.709809, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20476083') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dc430c46-26b0-53cd-b276-c96c82cbdc68 with identifier: 20473314
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-03-29 20:16:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dc430c46-26b0-53cd-b276-c96c82cbdc68 with identifier: 20473314
2026-03-29 20:16:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dc430c46-26b0-53cd-b276-c96c82cbdc68 with identifier: 20473314 to the API
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:05 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'dc430c46-26b0-53cd-b276-c96c82cbdc68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YP69 AZA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20473314',
'listing': 'auction',
'location': 'Hertfordshire Watford',
'make': 'Volvo',
'model': 'XC40',
'odometer': 55035,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_driver-1774699458549.jpg',
'https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_driver-1774699427976.jpg',
'https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_passenger-1774699454932.jpg',
'https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_passenger-1774699440750.jpg',
'https://motorway-photos.imgix.net/3314/20473314/interior_front_seats-1774700384698.jpg',
'https://motorway-photos.imgix.net/3314/20473314/interior_rear_seats-1774700422376.jpg',
'https://motorway-photos-redacted.imgix.net/3314/20473314/interior_dashboard-1774700475824.jpg',
'https://motorway-photos-redacted.imgix.net/3314/20473314/instrument_cluster-1774700487748.jpg',
'https://motorway-photos.imgix.net/3314/20473314/interior_boot-1774700478540.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/3314/20473314/docs_service_history-1774700605705.jpg?ixlib=js-3.8.0&auto=format&s=755028a412f12e6a71adf5a9e8116846'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588652,
'Height': 2351,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_driver-1774699458549.jpg',
'Width': 3135},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2365187,
'Height': 2798,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_front_passenger-1774699454932.jpg',
'Width': 3731},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1968623,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3314/20473314/exterior_rear_passenger-1774699440750.jpg',
'Width': 3495},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1644328,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3314/20473314/interior_dashboard-1774700475824.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1920095,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3314/20473314/instrument_cluster-1774700487748.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc430c46-26b0-53cd-b276-c96c82cbdc68/dc430c46-26b0-53cd-b276-c96c82cbdc68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3993566,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3314/20473314/interior_boot-1774700478540.jpg',
'Width': 4032}],
'price': 16312,
'price_includes_vat': False,
'registration_date': '2019-11-16',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC40 R-DESIGN D3 Auto',
'transmission': 'automatic',
'trim': 'R-DESIGN D3 Auto',
'vin': 'YV1XZ72VDL2254585',
'year': 2019}
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473314%27 HTTP/1.1" 200 None
2026-03-29 20:16:05 [motorway.uk] INFO: Saving data for 20473314: {'created_time': 1774815365.322102, 'last_price_update_time': 1774815365.322112, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20473314') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 with identifier: 19874916
2026-03-29 20:16:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 with identifier: 19874916
2026-03-29 20:16:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 with identifier: 19874916 to the API
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:05 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '7efdf3d4-2727-5af9-b5d0-3c2370f08e37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'E3 GKM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19874916',
'listing': 'auction',
'location': 'Central Bedfordshire Leighton Buzzard',
'make': 'Tesla',
'model': 'Model S',
'odometer': 96000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_front_driver-1773159995884.jpg',
'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_rear_driver-1773160010621.jpg',
'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_front_passenger-1773160061762.jpg',
'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_rear_passenger-1773160030292.jpg',
'https://motorway-photos-modified.imgix.net/4916/19874916/interior_front_seats-1773324997097.jpg',
'https://motorway-photos-modified.imgix.net/4916/19874916/interior_rear_seats-1773325008150.jpg',
'https://motorway-photos-modified.imgix.net/4916/19874916/interior_dashboard-1773325013884.jpg',
'https://motorway-photos-modified.imgix.net/4916/19874916/instrument_cluster-1773325073844.jpg',
'https://motorway-photos-modified.imgix.net/4916/19874916/interior_boot-1773325020832.jpg',
'https://motorway-service-history-photos.imgix.net/modified/4916/19874916/docs_service_history-1773325434325.jpg?ixlib=js-3.8.0&auto=format&s=ea0fc0aa48376138670fe2a70b0af385'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1922637,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_front_driver-1773159995884.jpg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2227395,
'Height': 2869,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_rear_driver-1773160010621.jpg',
'Width': 3825},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2059962,
'Height': 2954,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_front_passenger-1773160061762.jpg',
'Width': 3939},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2376238,
'Height': 2871,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/19874916/exterior_rear_passenger-1773160030292.jpg',
'Width': 3828},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731914,
'Height': 1669,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4916/19874916/interior_front_seats-1773324997097.jpg',
'Width': 2226},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655260,
'Height': 1749,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4916/19874916/interior_rear_seats-1773325008150.jpg',
'Width': 2332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1421128,
'Height': 2305,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4916/19874916/interior_dashboard-1773325013884.jpg',
'Width': 3074},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efdf3d4-2727-5af9-b5d0-3c2370f08e37/7efdf3d4-2727-5af9-b5d0-3c2370f08e37_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113715,
'Height': 1186,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4916/19874916/docs_service_history-1773325434325.jpg?ixlib=js-3.8.0&auto=format&s=ea0fc0aa48376138670fe2a70b0af385',
'Width': 1581}],
'price': 9718,
'price_includes_vat': False,
'registration_date': '2016-03-25',
'seats_number': None,
'seller_name': None,
'title': 'Tesla Model S 90D',
'transmission': 'automatic',
'trim': '90D',
'vin': '5YJSB7E27GF126812',
'year': 2016}
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719874916%27 HTTP/1.1" 200 None
2026-03-29 20:16:05 [motorway.uk] INFO: Saving data for 19874916: {'created_time': 1774815365.696277, 'last_price_update_time': 1774815365.696288, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19874916') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 7e5b24b3-94b4-53a2-88d3-969ed013ebf2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item dc430c46-26b0-53cd-b276-c96c82cbdc68 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7efdf3d4-2727-5af9-b5d0-3c2370f08e37 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca41fd0>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9d163-23cc-5783-be2c-8c9f92256796/03d9d163-23cc-5783-be2c-8c9f92256796_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Finstrument_cluster-1774535467034.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/instrument_cluster-1774535467034.jpg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03d9d163-23cc-5783-be2c-8c9f92256796
2026-03-29 20:16:06 [scrapy.extensions.logstats] INFO: Crawled 42 pages (at 42 pages/min), scraped 22 items (at 22 items/min)
2026-03-29 20:16:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 242MiB
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 03d9d163-23cc-5783-be2c-8c9f92256796 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c28eaded-0231-5035-a550-1357380b079b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 95e35aef-e7ee-5beb-96da-3067b3511f10 with identifier: 20411106
2026-03-29 20:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 95e35aef-e7ee-5beb-96da-3067b3511f10 with identifier: 20411106
2026-03-29 20:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 95e35aef-e7ee-5beb-96da-3067b3511f10 with identifier: 20411106 to the API
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:06 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '95e35aef-e7ee-5beb-96da-3067b3511f10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW16 MHM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20411106',
'listing': 'auction',
'location': 'Buckinghamshire Aylesbury',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 39246,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_front_driver-1774707874170.jpg',
'https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_rear_driver-1774707837251.jpg',
'https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_front_passenger-1774707870170.jpg',
'https://motorway-photos-redacted.imgix.net/1106/20411106/exterior_rear_passenger-1774707872490.jpg',
'https://motorway-photos.imgix.net/1106/20411106/interior_front_seats-1774708631551.jpg',
'https://motorway-photos.imgix.net/1106/20411106/interior_rear_seats-1774708629339.jpg',
'https://motorway-photos-redacted.imgix.net/1106/20411106/interior_dashboard-1774708640879.jpg',
'https://motorway-photos-redacted.imgix.net/1106/20411106/instrument_cluster-1774708537957.jpg',
'https://motorway-photos.imgix.net/1106/20411106/interior_boot-1774708655690.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1106/20411106/docs_service_history-1774709177494.jpg?ixlib=js-3.8.0&auto=format&s=291e15f9376f959c04296fd90bbe6c61'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e35aef-e7ee-5beb-96da-3067b3511f10/95e35aef-e7ee-5beb-96da-3067b3511f10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 840501,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1106/20411106/interior_dashboard-1774708640879.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e35aef-e7ee-5beb-96da-3067b3511f10/95e35aef-e7ee-5beb-96da-3067b3511f10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 897027,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1106/20411106/instrument_cluster-1774708537957.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95e35aef-e7ee-5beb-96da-3067b3511f10/95e35aef-e7ee-5beb-96da-3067b3511f10_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1774099,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/1106/20411106/interior_boot-1774708655690.jpg',
'Width': 3840}],
'price': 10815,
'price_includes_vat': False,
'registration_date': '2016-06-08',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-5 Sport NAV D 4X4 Auto',
'transmission': 'automatic',
'trim': 'Sport NAV D 4X4 Auto',
'vin': 'JMZKEN92800489675',
'year': 2016}
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411106%27 HTTP/1.1" 200 None
2026-03-29 20:16:06 [motorway.uk] INFO: Saving data for 20411106: {'created_time': 1774815366.425056, 'last_price_update_time': 1774815366.425067, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20411106') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 95e35aef-e7ee-5beb-96da-3067b3511f10 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_passenger-1774515143597.jpg> (referer: None)
2026-03-29 20:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2551/20382551/interior_dashboard-1774535441844.jpg> (referer: None)
2026-03-29 20:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_rear_passenger-1774515041394.jpg> (referer: None)
2026-03-29 20:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2517/19662517/interior_rear_seats-1770541551829.jpg> (referer: None)
2026-03-29 20:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2551/20382551/interior_rear_seats-1774535543043.jpg> (referer: None)
2026-03-29 20:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_passenger-1774691755381.jpg> (referer: None)
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec9e690>
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_front_passenger-1774515143597.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_passenger-1774515143597.jpg saved to cache
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec8a9d0>
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9d163-23cc-5783-be2c-8c9f92256796/03d9d163-23cc-5783-be2c-8c9f92256796_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2551%252F20382551%252Finterior_dashboard-1774535441844.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2551/20382551/interior_dashboard-1774535441844.jpg saved to cache
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03d9d163-23cc-5783-be2c-8c9f92256796
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e066150>
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7069%252F20437069%252Fexterior_rear_passenger-1774515041394.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_rear_passenger-1774515041394.jpg saved to cache
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f
2026-03-29 20:16:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f, skipping ID generation
2026-03-29 20:16:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f with scrape type 1
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f sending to next pipeline
2026-03-29 20:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f, identifier: 20437069
2026-03-29 20:16:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:16:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec88ed0>
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c28eaded-0231-5035-a550-1357380b079b/c28eaded-0231-5035-a550-1357380b079b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2517%252F19662517%252Finterior_rear_seats-1770541551829.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2517/19662517/interior_rear_seats-1770541551829.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c28eaded-0231-5035-a550-1357380b079b
2026-03-29 20:16:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c28eaded-0231-5035-a550-1357380b079b, skipping ID generation
2026-03-29 20:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28eaded-0231-5035-a550-1357380b079b with scrape type 1
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c28eaded-0231-5035-a550-1357380b079b sending to next pipeline
2026-03-29 20:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c28eaded-0231-5035-a550-1357380b079b, identifier: 19662517
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d027210>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d9d163-23cc-5783-be2c-8c9f92256796/03d9d163-23cc-5783-be2c-8c9f92256796_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2551%252F20382551%252Finterior_rear_seats-1774535543043.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2551/20382551/interior_rear_seats-1774535543043.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03d9d163-23cc-5783-be2c-8c9f92256796
2026-03-29 20:16:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03d9d163-23cc-5783-be2c-8c9f92256796, skipping ID generation
2026-03-29 20:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d9d163-23cc-5783-be2c-8c9f92256796 with scrape type 1
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03d9d163-23cc-5783-be2c-8c9f92256796 sending to next pipeline
2026-03-29 20:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 03d9d163-23cc-5783-be2c-8c9f92256796, identifier: 20382551
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d024390>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1b12e-3c4e-5742-a54f-98b5cf397d25/7dc1b12e-3c4e-5742-a54f-98b5cf397d25_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1390%252F18971390%252Fexterior_rear_passenger-1774691755381.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_passenger-1774691755381.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25
2026-03-29 20:16:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f with identifier: 20437069
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Gold HTTP/1.1" 200 None
2026-03-29 20:16:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f with identifier: 20437069
2026-03-29 20:16:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f with identifier: 20437069 to the API
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_rear_passenger-1774515041394.jpg>
{'auction_title': '',
'category': None,
'color': 'Gold',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU15 VAF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20437069',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Ford',
'model': 'B-MAX',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1199528,
'Height': 2221,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_driver-1774515048058.jpg',
'Width': 2961},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1330607,
'Height': 2489,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_front_passenger-1774515143597.jpg',
'Width': 3318},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672095,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7069/20437069/exterior_rear_passenger-1774515041394.jpg',
'Width': 3452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f/f6bff4c5-c86d-5fb6-8e0f-c6d25b38833f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1919593,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7069/20437069/damage_scratches-1774515198318.jpg',
'Width': 3840}],
'price': 3954,
'price_includes_vat': False,
'registration_date': '2015-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford B-MAX Zetec Auto',
'transmission': 'automatic',
'trim': 'Zetec Auto',
'vin': 'WF0KXXERJKFS89470',
'year': 2015}
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720437069%27 HTTP/1.1" 200 None
2026-03-29 20:16:08 [motorway.uk] INFO: Saving data for 20437069: {'created_time': 1774815368.163994, 'last_price_update_time': 1774815368.164005, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20437069') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c28eaded-0231-5035-a550-1357380b079b with identifier: 19662517
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid HTTP/1.1" 200 None
2026-03-29 20:16:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c28eaded-0231-5035-a550-1357380b079b with identifier: 19662517
2026-03-29 20:16:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c28eaded-0231-5035-a550-1357380b079b with identifier: 19662517 to the API
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2517/19662517/interior_rear_seats-1770541551829.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'c28eaded-0231-5035-a550-1357380b079b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GY24 YJS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19662517',
'listing': 'auction',
'location': 'West Sussex Littlehampton',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 12411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28eaded-0231-5035-a550-1357380b079b/c28eaded-0231-5035-a550-1357380b079b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1467352,
'Height': 2574,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2517/19662517/exterior_front_passenger-1770541232477.jpg',
'Width': 3432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c28eaded-0231-5035-a550-1357380b079b/c28eaded-0231-5035-a550-1357380b079b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2880192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2517/19662517/interior_rear_seats-1770541551829.jpg',
'Width': 4032}],
'price': 34225,
'price_includes_vat': False,
'registration_date': '2024-08-01',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport DYN HSE PHEV A',
'transmission': 'automatic',
'trim': 'Sport DYN HSE PHEV A',
'vin': 'SALCA2AT7SH354478',
'year': 2024}
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719662517%27 HTTP/1.1" 200 None
2026-03-29 20:16:08 [motorway.uk] INFO: Saving data for 19662517: {'created_time': 1774815368.746041, 'last_price_update_time': 1774815368.746054, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19662517') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 03d9d163-23cc-5783-be2c-8c9f92256796 with identifier: 20382551
2026-03-29 20:16:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 03d9d163-23cc-5783-be2c-8c9f92256796 with identifier: 20382551
2026-03-29 20:16:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 03d9d163-23cc-5783-be2c-8c9f92256796 with identifier: 20382551 to the API
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2551/20382551/interior_rear_seats-1774535543043.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '03d9d163-23cc-5783-be2c-8c9f92256796',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX68 HCA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20382551',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Volvo',
'model': 'V40',
'odometer': 41268,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9d163-23cc-5783-be2c-8c9f92256796/03d9d163-23cc-5783-be2c-8c9f92256796_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3028052,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2551/20382551/interior_rear_seats-1774535543043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9d163-23cc-5783-be2c-8c9f92256796/03d9d163-23cc-5783-be2c-8c9f92256796_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627057,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2551/20382551/interior_dashboard-1774535441844.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d9d163-23cc-5783-be2c-8c9f92256796/03d9d163-23cc-5783-be2c-8c9f92256796_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3399637,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2551/20382551/instrument_cluster-1774535467034.jpg',
'Width': 4032}],
'price': 9548,
'price_includes_vat': False,
'registration_date': '2018-12-17',
'seats_number': None,
'seller_name': None,
'title': 'Volvo V40 Momentum NAV + T2 Auto',
'transmission': 'automatic',
'trim': 'Momentum NAV + T2 Auto',
'vin': 'YV1MV33V0K2573593',
'year': 2018}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382551%27 HTTP/1.1" 200 None
2026-03-29 20:16:09 [motorway.uk] INFO: Saving data for 20382551: {'created_time': 1774815369.172119, 'last_price_update_time': 1774815369.17213, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20382551') HTTP/1.1" 204 0
2026-03-29 20:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4366/15524366/interior_front_seats-1774095921229.jpg> (referer: None)
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 with identifier: 18971390
2026-03-29 20:16:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 with identifier: 18971390
2026-03-29 20:16:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 with identifier: 18971390 to the API
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:09 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '7dc1b12e-3c4e-5742-a54f-98b5cf397d25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M121 JMM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18971390',
'listing': 'auction',
'location': 'Falkirk Falkirk',
'make': 'Porsche',
'model': 'Panamera',
'odometer': 21700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_front_driver-1774691744027.jpg',
'https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_driver-1774691752196.jpg',
'https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_front_passenger-1774691753661.jpg',
'https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_passenger-1774691755381.jpg',
'https://motorway-photos.imgix.net/1390/18971390/interior_front_seats-1774691489450.jpg',
'https://motorway-photos.imgix.net/1390/18971390/interior_rear_seats-1774691432364.jpg',
'https://motorway-photos-modified.imgix.net/1390/18971390/interior_dashboard-1774695024607.jpg',
'https://motorway-photos.imgix.net/1390/18971390/interior_boot-1774691464797.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1390/18971390/docs_service_history-1774691673823.jpg?ixlib=js-3.8.0&auto=format&s=d1fb49c0651f2c638b6d3778d57e062f',
'https://motorway-photos-redacted.imgix.net/1390/18971390/wheels_front_driver-1774691747216.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1b12e-3c4e-5742-a54f-98b5cf397d25/7dc1b12e-3c4e-5742-a54f-98b5cf397d25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3190211,
'Height': 2967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1390/18971390/exterior_rear_passenger-1774691755381.jpg',
'Width': 3956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1b12e-3c4e-5742-a54f-98b5cf397d25/7dc1b12e-3c4e-5742-a54f-98b5cf397d25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3141380,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1390/18971390/interior_rear_seats-1774691432364.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1b12e-3c4e-5742-a54f-98b5cf397d25/7dc1b12e-3c4e-5742-a54f-98b5cf397d25_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2125970,
'Height': 3002,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1390/18971390/wheels_front_driver-1774691747216.jpg',
'Width': 4003}],
'price': 71531,
'price_includes_vat': False,
'registration_date': '2024-09-10',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Panamera 4 E-HYBRID S-A',
'transmission': 'automatic',
'trim': '4 E-HYBRID S-A',
'vin': 'WP0ZZZYA4RL070210',
'year': 2024}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718971390%27 HTTP/1.1" 200 None
2026-03-29 20:16:09 [motorway.uk] INFO: Saving data for 18971390: {'created_time': 1774815369.705984, 'last_price_update_time': 1774815369.705998, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18971390') HTTP/1.1" 204 0
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4366/15524366/interior_rear_seats-1774095582313.jpg> (referer: None)
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7dc1b12e-3c4e-5742-a54f-98b5cf397d25 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b3650>
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4366%252F15524366%252Finterior_front_seats-1774095921229.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4366/15524366/interior_front_seats-1774095921229.jpg saved to cache
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_passenger-1774698824566.jpg> (referer: None)
2026-03-29 20:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_driver-1774698772258.jpg> (referer: None)
2026-03-29 20:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9276/20479276/instrument_cluster-1774699199812.jpg> (referer: None)
2026-03-29 20:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_passenger-1774698805872.jpg> (referer: None)
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b7bd0>
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4366%252F15524366%252Finterior_rear_seats-1774095582313.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4366/15524366/interior_rear_seats-1774095582313.jpg saved to cache
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9
2026-03-29 20:16:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5770ffef-4e0d-518d-8cd1-a45ab52561a9, skipping ID generation
2026-03-29 20:16:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 with scrape type 1
2026-03-29 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5770ffef-4e0d-518d-8cd1-a45ab52561a9 sending to next pipeline
2026-03-29 20:16:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5770ffef-4e0d-518d-8cd1-a45ab52561a9, identifier: 15524366
2026-03-29 20:16:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5770ffef-4e0d-518d-8cd1-a45ab52561a9 with identifier: 15524366
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-03-29 20:16:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5770ffef-4e0d-518d-8cd1-a45ab52561a9 with identifier: 15524366
2026-03-29 20:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5770ffef-4e0d-518d-8cd1-a45ab52561a9 with identifier: 15524366 to the API
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4366/15524366/interior_rear_seats-1774095582313.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5770ffef-4e0d-518d-8cd1-a45ab52561a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'A7 GJY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15524366',
'listing': 'auction',
'location': 'Dorset Bournemouth',
'make': 'Ford',
'model': 'Mustang',
'odometer': 17900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187451,
'Height': 707,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_driver-1774095125196.jpg',
'Width': 943},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194067,
'Height': 686,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_driver-1774095068366.jpg',
'Width': 914},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188841,
'Height': 699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_front_passenger-1774095041878.jpg',
'Width': 932},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145091,
'Height': 676,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4366/15524366/exterior_rear_passenger-1774094973864.jpg',
'Width': 901},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245686,
'Height': 765,
'OriginUrl': 'https://motorway-photos.imgix.net/4366/15524366/interior_front_seats-1774095921229.jpg',
'Width': 1020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5770ffef-4e0d-518d-8cd1-a45ab52561a9/5770ffef-4e0d-518d-8cd1-a45ab52561a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199686,
'Height': 765,
'OriginUrl': 'https://motorway-photos.imgix.net/4366/15524366/interior_rear_seats-1774095582313.jpg',
'Width': 1020}],
'price': 26329,
'price_includes_vat': False,
'registration_date': '2019-06-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Mustang Ecoboost Auto',
'transmission': 'automatic',
'trim': 'Ecoboost Auto',
'vin': '1FATP8MH1K5140089',
'year': 2019}
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715524366%27 HTTP/1.1" 200 None
2026-03-29 20:16:10 [motorway.uk] INFO: Saving data for 15524366: {'created_time': 1774815370.523132, 'last_price_update_time': 1774815370.523142, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15524366') HTTP/1.1" 204 0
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2ebd0>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_front_passenger-1774698824566.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_passenger-1774698824566.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d741e10>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_rear_driver-1774698772258.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_driver-1774698772258.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb
2026-03-29 20:16:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0149d0>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Finstrument_cluster-1774699199812.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/instrument_cluster-1774699199812.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d507090>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9276%252F20479276%252Fexterior_rear_passenger-1774698805872.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_passenger-1774698805872.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 623ecb1b-5694-537a-9cfd-77a52cb482cb with identifier: 20479276
2026-03-29 20:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 623ecb1b-5694-537a-9cfd-77a52cb482cb with identifier: 20479276
2026-03-29 20:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 623ecb1b-5694-537a-9cfd-77a52cb482cb with identifier: 20479276 to the API
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:11 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '623ecb1b-5694-537a-9cfd-77a52cb482cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ69 WUP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20479276',
'listing': 'auction',
'location': 'Surrey Staines',
'make': 'Ford',
'model': 'Transit',
'odometer': 71000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_driver-1774698758974.jpg',
'https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_driver-1774698772258.jpg',
'https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_passenger-1774698824566.jpg',
'https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_passenger-1774698805872.jpg',
'https://motorway-photos.imgix.net/9276/20479276/interior_front_seats-1774699113275.jpg',
'https://motorway-photos.imgix.net/9276/20479276/interior_rear_seats-1774699189326.jpg',
'https://motorway-photos-modified.imgix.net/9276/20479276/interior_dashboard-1774709388204.jpg',
'https://motorway-photos-redacted.imgix.net/9276/20479276/instrument_cluster-1774699199812.jpg',
'https://motorway-photos.imgix.net/9276/20479276/interior_boot-1774699163854.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/9276/20479276/docs_service_history-1774701036356.jpg?ixlib=js-3.8.0&auto=format&s=2e49d26a834565141a5ed0e167c635a0'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1553380,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_driver-1774698772258.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620233,
'Height': 1522,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_front_passenger-1774698824566.jpg',
'Width': 2029},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1509919,
'Height': 2466,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9276/20479276/exterior_rear_passenger-1774698805872.jpg',
'Width': 3288},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2318864,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9276/20479276/instrument_cluster-1774699199812.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623ecb1b-5694-537a-9cfd-77a52cb482cb/623ecb1b-5694-537a-9cfd-77a52cb482cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4193832,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9276/20479276/interior_boot-1774699163854.jpg',
'Width': 4032}],
'price': 16771,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Custom 320SPRT Eblue A',
'transmission': 'automatic',
'trim': 'Custom 320SPRT Eblue A',
'vin': 'WF0ZXXTTGZKM25713',
'year': 2019}
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479276%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [motorway.uk] INFO: Saving data for 20479276: {'created_time': 1774815371.33314, 'last_price_update_time': 1774815371.333151, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20479276') HTTP/1.1" 204 0
2026-03-29 20:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 623ecb1b-5694-537a-9cfd-77a52cb482cb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487257.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=180&page=5&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_passenger-1774708848672.jpg> (referer: None)
2026-03-29 20:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8931/19478931/instrument_cluster-1774709550148.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8931/19478931/interior_front_seats-1774709479095.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8931/19478931/interior_boot-1774709693322.jpg> (referer: None)
2026-03-29 20:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00b9f79f-c193-5204-8c49-e7138c02d04a with identifier: 20487257
2026-03-29 20:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b9f79f-c193-5204-8c49-e7138c02d04a with scrape type 1
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_front_driver-1774702272592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_driver-1774702272592.jpg not downloaded yet
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_rear_driver-1774702270879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_driver-1774702270879.jpg not downloaded yet
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 12933192
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 19413644
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719413644%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [motorway.uk] INFO: Scrape type for 19413644: 1
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_front_passenger-1774702330524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_passenger-1774702330524.jpg not downloaded yet
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 20447824
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 20458673
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 20493712
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 19203575
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 20421091
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421091%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [motorway.uk] INFO: Scrape type for 20421091: 1
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28e250>
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_rear_passenger-1774708848672.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_passenger-1774708848672.jpg saved to cache
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22f510>
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Finstrument_cluster-1774709550148.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/instrument_cluster-1774709550148.jpg saved to cache
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_rear_passenger-1774702309878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_passenger-1774702309878.jpg not downloaded yet
2026-03-29 20:16:11 [motorway.uk] INFO: Found listing with ID: 13065298
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713065298%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [motorway.uk] INFO: Scrape type for 13065298: 2
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d148410>
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8931%252F19478931%252Finterior_front_seats-1774709479095.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8931/19478931/interior_front_seats-1774709479095.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d17b450>
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8931%252F19478931%252Finterior_boot-1774709693322.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8931/19478931/interior_boot-1774709693322.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7257%252F20487257%252Finterior_front_seats-1774703185840.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7257/20487257/interior_front_seats-1774703185840.jpg not downloaded yet
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 18832352
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 19439933
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20275909
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20423182
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423182%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 20423182: 1
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7257%252F20487257%252Finterior_rear_seats-1774703256830.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7257/20487257/interior_rear_seats-1774703256830.jpg not downloaded yet
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20445222
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20488693
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488693%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 20488693: 1
2026-03-29 20:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Finterior_dashboard-1774703315843.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/interior_dashboard-1774703315843.jpg not downloaded yet
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 19816072
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20478238
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 13689897
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20446195
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 17461058
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20421275
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421275%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 20421275: 1
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Finstrument_cluster-1774703267080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/instrument_cluster-1774703267080.jpg not downloaded yet
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 3909564
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 19490864
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719490864%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 19490864: 2
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7257%252F20487257%252Finterior_boot-1774703392477.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7257/20487257/interior_boot-1774703392477.jpg not downloaded yet
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 18327972
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20286049
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 4371469
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20404359
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 9314864
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20489620
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 18663443
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 18821611
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 5937182
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 19115404
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20341600
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720341600%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 20341600: 1
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7257%252F20487257%252Fdocs_service_history-1774703800047.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0abe9ef24da5a68619ec09af5d90db0c%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7257/20487257/docs_service_history-1774703800047.jpg?ixlib=js-3.8.0&auto=format&s=0abe9ef24da5a68619ec09af5d90db0c not downloaded yet
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 19718816
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 19360225
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719360225%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 19360225: 1
2026-03-29 20:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19110205.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490005.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:12 [motorway.uk] INFO: Found listing with ID: 20098323
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720098323%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [motorway.uk] INFO: Scrape type for 20098323: 1
2026-03-29 20:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_driver-1774708674665.jpg> (referer: None)
2026-03-29 20:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_front_passenger-1774708977598.jpg> (referer: None)
2026-03-29 20:16:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1bd4d08-aecc-50b1-81fd-3475ae89dff9 with identifier: 19110205
2026-03-29 20:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9 with scrape type 1
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0205%252F19110205%252Fexterior_front_driver-1774632360079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_front_driver-1774632360079.jpg not downloaded yet
2026-03-29 20:16:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532a6416-7876-50d7-a49e-45c2b515063c with identifier: 20490005
2026-03-29 20:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532a6416-7876-50d7-a49e-45c2b515063c with scrape type 1
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_front_driver-1774709759875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_driver-1774709759875.jpg not downloaded yet
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 96553639-abb3-5226-a7a8-2c6bbb6df999 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0205%252F19110205%252Fexterior_rear_driver-1774632337910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_rear_driver-1774632337910.jpg not downloaded yet
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_rear_driver-1774709691084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_driver-1774709691084.jpg not downloaded yet
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05a610>
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_rear_driver-1774708674665.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_driver-1774708674665.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13ef10>
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8931%252F19478931%252Fexterior_front_passenger-1774708977598.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_front_passenger-1774708977598.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7
2026-03-29 20:16:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6add6f53-0eca-5f72-aad6-d0e4ce0323d7, skipping ID generation
2026-03-29 20:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 with scrape type 1
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 sending to next pipeline
2026-03-29 20:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6add6f53-0eca-5f72-aad6-d0e4ce0323d7, identifier: 19478931
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0205%252F19110205%252Fexterior_front_passenger-1774633910777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0205/19110205/exterior_front_passenger-1774633910777.jpg not downloaded yet
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_front_passenger-1774709695368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_passenger-1774709695368.jpg not downloaded yet
2026-03-29 20:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 with identifier: 19478931
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Yellow HTTP/1.1" 200 None
2026-03-29 20:16:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 with identifier: 19478931
2026-03-29 20:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6add6f53-0eca-5f72-aad6-d0e4ce0323d7 with identifier: 19478931 to the API
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_front_passenger-1774708977598.jpg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '5.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6add6f53-0eca-5f72-aad6-d0e4ce0323d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ18 VPY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19478931',
'listing': 'auction',
'location': 'Greater London South Croydon',
'make': 'Ford',
'model': 'Mustang',
'odometer': 48465,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1797948,
'Height': 2906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_driver-1774708674665.jpg',
'Width': 3875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2049060,
'Height': 2741,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_front_passenger-1774708977598.jpg',
'Width': 3655},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1869504,
'Height': 2919,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8931/19478931/exterior_rear_passenger-1774708848672.jpg',
'Width': 3892},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3870335,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8931/19478931/interior_front_seats-1774709479095.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4434734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8931/19478931/interior_rear_seats-1774709538669.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3736998,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8931/19478931/interior_dashboard-1774709642495.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2595682,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8931/19478931/instrument_cluster-1774709550148.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6add6f53-0eca-5f72-aad6-d0e4ce0323d7/6add6f53-0eca-5f72-aad6-d0e4ce0323d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4111244,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8931/19478931/interior_boot-1774709693322.jpg',
'Width': 4032}],
'price': 25300,
'price_includes_vat': False,
'registration_date': '2018-04-15',
'seats_number': None,
'seller_name': None,
'title': 'Ford Mustang GT',
'transmission': 'manual',
'trim': 'GT',
'vin': '1FATP8FF2H5326311',
'year': 2018}
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719478931%27 HTTP/1.1" 200 None
2026-03-29 20:16:13 [motorway.uk] INFO: Saving data for 19478931: {'created_time': 1774815373.833854, 'last_price_update_time': 1774815373.833865, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19478931') HTTP/1.1" 204 0
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0205%252F19110205%252Fexterior_rear_passenger-1774633956180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0205/19110205/exterior_rear_passenger-1774633956180.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_rear_passenger-1774709697559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_passenger-1774709697559.jpg not downloaded yet
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20496977.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0205%252F19110205%252Finterior_front_seats-1774632628901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0205/19110205/interior_front_seats-1774632628901.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0005%252F20490005%252Finterior_front_seats-1774710894152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0005/20490005/interior_front_seats-1774710894152.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0205%252F19110205%252Finterior_dashboard-1774634130950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0205/19110205/interior_dashboard-1774634130950.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0005%252F20490005%252Finterior_rear_seats-1774710889409.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0005/20490005/interior_rear_seats-1774710889409.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 00b9f79f-c193-5204-8c49-e7138c02d04a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0205%252F19110205%252Finstrument_cluster-1774632880727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0205/19110205/instrument_cluster-1774632880727.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Finterior_dashboard-1774710938981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/interior_dashboard-1774710938981.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0205%252F19110205%252Finterior_boot-1774633010279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0205/19110205/interior_boot-1774633010279.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Finstrument_cluster-1774710957633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/instrument_cluster-1774710957633.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0205%252F19110205%252Fdocs_service_history-1774633428564.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3dab1d0e71dd4c1f9845cedf9ee489e%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633428564.jpg?ixlib=js-3.8.0&auto=format&s=a3dab1d0e71dd4c1f9845cedf9ee489e not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0005%252F20490005%252Finterior_boot-1774710891555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0005/20490005/interior_boot-1774710891555.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7267eea1-fa38-5f52-b069-269a46f5babb with identifier: 20496977
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7267eea1-fa38-5f52-b069-269a46f5babb with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_front_driver-1774773714854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_driver-1774773714854.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0205%252F19110205%252Fdocs_service_history-1774633430520.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ffb8fc7893eb73c7abe9f438fcab0a2%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633430520.jpg?ixlib=js-3.8.0&auto=format&s=5ffb8fc7893eb73c7abe9f438fcab0a2 not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0005%252F20490005%252Fdocs_service_history-1774711072764.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7cfc1cd1ebbe11b0ecac8bcc70d6c560%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0005/20490005/docs_service_history-1774711072764.jpg?ixlib=js-3.8.0&auto=format&s=7cfc1cd1ebbe11b0ecac8bcc70d6c560 not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_rear_driver-1774773733899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_driver-1774773733899.jpg not downloaded yet
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487361.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19657268.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_front_passenger-1774773781884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_passenger-1774773781884.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_rear_passenger-1774773775696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_passenger-1774773775696.jpg not downloaded yet
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7257/20487257/instrument_cluster-1774703267080.jpg> (referer: None)
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6977%252F20496977%252Finterior_front_seats-1774774327560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6977/20496977/interior_front_seats-1774774327560.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6977%252F20496977%252Finterior_rear_seats-1774774341001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6977/20496977/interior_rear_seats-1774774341001.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6977%252F20496977%252Finterior_dashboard-1774775494561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6977/20496977/interior_dashboard-1774775494561.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ac2bae-307c-51ca-8d47-a7e0dd415c93 with identifier: 20487361
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Fexterior_front_driver-1774700820014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_front_driver-1774700820014.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f86745c7-c61f-5400-a5e8-94c8fc922fb7 with identifier: 19657268
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f86745c7-c61f-5400-a5e8-94c8fc922fb7
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_front_driver-1774629401167.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_front_driver-1774629401167.jpeg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Finstrument_cluster-1774774420259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/instrument_cluster-1774774420259.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Fexterior_rear_driver-1774700837503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_rear_driver-1774700837503.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_rear_driver-1774629839060.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_driver-1774629839060.jpeg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6977%252F20496977%252Finterior_boot-1774775470837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6977/20496977/interior_boot-1774775470837.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Fexterior_front_passenger-1774700859803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_front_passenger-1774700859803.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_front_passenger-1774629548226.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_front_passenger-1774629548226.jpeg not downloaded yet
2026-03-29 20:16:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadf410>
2026-03-29 20:16:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Finstrument_cluster-1774703267080.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/instrument_cluster-1774703267080.jpg saved to cache
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6977%252F20496977%252Fdocs_service_history-1774774508685.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8a369114b91c119a8a25e88098fb658%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6977/20496977/docs_service_history-1774774508685.jpg?ixlib=js-3.8.0&auto=format&s=d8a369114b91c119a8a25e88098fb658 not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Fexterior_rear_passenger-1774700843890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_rear_passenger-1774700843890.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_rear_passenger-1774629831866.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_passenger-1774629831866.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7361%252F20487361%252Finterior_front_seats-1774701167663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7361/20487361/interior_front_seats-1774701167663.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F19657268%252Finterior_front_seats-1774629923994.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/19657268/interior_front_seats-1774629923994.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7361%252F20487361%252Finterior_rear_seats-1774701188165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7361/20487361/interior_rear_seats-1774701188165.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7268%252F19657268%252F19657268-interior_dashboard-modified-1774708158482.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7268/19657268/19657268-interior_dashboard-modified-1774708158482.jpeg not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20423182.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Finterior_dashboard-1774701220043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/interior_dashboard-1774701220043.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Finstrument_cluster-1774630081211.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/instrument_cluster-1774630081211.jpeg not downloaded yet
2026-03-29 20:16:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_passenger-1774709695368.jpg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Finstrument_cluster-1774701282398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/instrument_cluster-1774701282398.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F19657268%252Finterior_boot-1774629999343.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/19657268/interior_boot-1774629999343.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7361%252F20487361%252Finterior_boot-1774701258013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7361/20487361/interior_boot-1774701258013.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7268%252F19657268%252F19657268-docs_service_history-modified-1774708282507.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4ce5342d39cf2652b3ad623e030c7ba7%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7268/19657268/19657268-docs_service_history-modified-1774708282507.jpeg?ixlib=js-3.8.0&auto=format&s=4ce5342d39cf2652b3ad623e030c7ba7 not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_passenger-1774773775696.jpg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7361%252F20487361%252Fdocs_service_history-1774715161702.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D84a423e2c4d3658695dca81268bf8bee%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7361/20487361/docs_service_history-1774715161702.jpg?ixlib=js-3.8.0&auto=format&s=84a423e2c4d3658695dca81268bf8bee not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fwheels_front_driver-1774630087662.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/wheels_front_driver-1774630087662.jpeg not downloaded yet
2026-03-29 20:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b952e3-1ade-5a84-8d2e-dbffd2316a23 with identifier: 20423182
2026-03-29 20:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 with scrape type 1
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_front_driver-1774624913965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_driver-1774624913965.jpg not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_driver-1774773733899.jpg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_rear_driver-1774625124362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_driver-1774625124362.jpg not downloaded yet
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c300a10>
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_front_passenger-1774709695368.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_passenger-1774709695368.jpg saved to cache
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_front_passenger-1774625027219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_passenger-1774625027219.jpg not downloaded yet
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d031c90>
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_rear_passenger-1774773775696.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_passenger-1774773775696.jpg saved to cache
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d544190>
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_rear_driver-1774773733899.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_driver-1774773733899.jpg saved to cache
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_rear_passenger-1774625156328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_passenger-1774625156328.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3182%252F20423182%252Finterior_front_seats-1774625519777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3182/20423182/interior_front_seats-1774625519777.jpg not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13065298.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3182%252F20423182%252Finterior_rear_seats-1774625540085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3182/20423182/interior_rear_seats-1774625540085.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3182%252F20423182%252Finterior_dashboard-1774632218635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3182/20423182/interior_dashboard-1774632218635.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3182%252F20423182%252Finstrument_cluster-1774631864389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3182/20423182/instrument_cluster-1774631864389.jpg not downloaded yet
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 532a6416-7876-50d7-a49e-45c2b515063c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3182%252F20423182%252Finterior_boot-1774625589610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3182/20423182/interior_boot-1774625589610.jpg not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/19657268/instrument_cluster-1774630081211.jpeg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3182%252F20423182%252Fdocs_service_history-1774708028476.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6c36e09fd8c4192a2e705b4d30991a7%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3182/20423182/docs_service_history-1774708028476.jpg?ixlib=js-3.8.0&auto=format&s=b6c36e09fd8c4192a2e705b4d30991a7 not downloaded yet
2026-03-29 20:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e1648b5-72fa-59e6-ad6a-b5d1e2664026 with identifier: 13065298
2026-03-29 20:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1648b5-72fa-59e6-ad6a-b5d1e2664026 with scrape type 2
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e1648b5-72fa-59e6-ad6a-b5d1e2664026 with scrape type 2
2026-03-29 20:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0e1648b5-72fa-59e6-ad6a-b5d1e2664026, identifier: 13065298
2026-03-29 20:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0e1648b5-72fa-59e6-ad6a-b5d1e2664026 with identifier: 13065298
2026-03-29 20:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0e1648b5-72fa-59e6-ad6a-b5d1e2664026 with identifier: 13065298
2026-03-29 20:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0e1648b5-72fa-59e6-ad6a-b5d1e2664026 with identifier: 13065298 to the API
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13065298.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0e1648b5-72fa-59e6-ad6a-b5d1e2664026',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ20 PBU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13065298',
'listing': 'auction',
'location': 'Gloucestershire Cirencester',
'make': 'Ford',
'model': 'Transit',
'odometer': 61000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 8800,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Connect 200 LTD TDCI',
'transmission': 'manual',
'trim': 'Connect 200 LTD TDCI',
'vin': 'WF0RXXWPGRKU06776',
'year': 2020}
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713065298%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [motorway.uk] INFO: Saving data for 13065298: {'auction_closing_time': 1774884600.0, 'created_time': 1774556457.373734, 'last_price_update_time': 1774815376.551166}
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13065298') HTTP/1.1" 204 0
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14bc5e10>
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Finstrument_cluster-1774630081211.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/instrument_cluster-1774630081211.jpeg saved to cache
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7
2026-03-29 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7257/20487257/interior_front_seats-1774703185840.jpg> (referer: None)
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7257/20487257/interior_boot-1774703392477.jpg> (referer: None)
2026-03-29 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19490864.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_passenger-1774625027219.jpg> (referer: None)
2026-03-29 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_driver-1774625124362.jpg> (referer: None)
2026-03-29 20:16:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03edd0>
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7257%252F20487257%252Finterior_front_seats-1774703185840.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7257/20487257/interior_front_seats-1774703185840.jpg saved to cache
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:16:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdcad0>
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7257%252F20487257%252Finterior_boot-1774703392477.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7257/20487257/interior_boot-1774703392477.jpg saved to cache
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:16:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9569bfee-2983-5ecf-a00e-6d902bae2220 with identifier: 19490864
2026-03-29 20:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9569bfee-2983-5ecf-a00e-6d902bae2220 with scrape type 2
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9569bfee-2983-5ecf-a00e-6d902bae2220 with scrape type 2
2026-03-29 20:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9569bfee-2983-5ecf-a00e-6d902bae2220, identifier: 19490864
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca37390>
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_front_passenger-1774625027219.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_passenger-1774625027219.jpg saved to cache
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d115010>
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_rear_driver-1774625124362.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_driver-1774625124362.jpg saved to cache
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23
2026-03-29 20:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9569bfee-2983-5ecf-a00e-6d902bae2220 with identifier: 19490864
2026-03-29 20:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9569bfee-2983-5ecf-a00e-6d902bae2220 with identifier: 19490864
2026-03-29 20:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9569bfee-2983-5ecf-a00e-6d902bae2220 with identifier: 19490864 to the API
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19490864.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9569bfee-2983-5ecf-a00e-6d902bae2220',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'A6 DVY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19490864',
'listing': 'auction',
'location': 'Surrey Caterham',
'make': 'Audi',
'model': 'A1',
'odometer': 34200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 16328,
'price_includes_vat': False,
'registration_date': '2021-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line 35 TFSI S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TFSI S-A',
'vin': 'WAUZZZGB8MR037675',
'year': 2021}
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719490864%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [motorway.uk] INFO: Saving data for 19490864: {'auction_closing_time': 1774884600.0, 'created_time': 1774556873.843417, 'last_price_update_time': 1774815378.030714}
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19490864') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3182/20423182/interior_rear_seats-1774625540085.jpg> (referer: None)
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/19657268/wheels_front_driver-1774630087662.jpeg> (referer: None)
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbebd90>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3182%252F20423182%252Finterior_rear_seats-1774625540085.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3182/20423182/interior_rear_seats-1774625540085.jpg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20421275.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce64a90>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fwheels_front_driver-1774630087662.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/wheels_front_driver-1774630087662.jpeg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7
2026-03-29 20:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71867087-b9b1-5ea1-9251-61d118905020 with identifier: 20421275
2026-03-29 20:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71867087-b9b1-5ea1-9251-61d118905020 with scrape type 1
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_front_driver-1774533062436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_front_driver-1774533062436.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_rear_driver-1774533063390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_driver-1774533063390.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_front_passenger-1774533068501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_front_passenger-1774533068501.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_rear_passenger-1774533067814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_passenger-1774533067814.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1275%252F20421275%252Finterior_front_seats-1774533820759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1275/20421275/interior_front_seats-1774533820759.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1275%252F20421275%252Finterior_rear_seats-1774533721905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1275/20421275/interior_rear_seats-1774533721905.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1275%252F20421275%252F20421275-interior_dashboard-modified-1774539676057.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1275/20421275/20421275-interior_dashboard-modified-1774539676057.jpeg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Finstrument_cluster-1774533711030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/instrument_cluster-1774533711030.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1275%252F20421275%252Finterior_boot-1774533720101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1275/20421275/interior_boot-1774533720101.jpg not downloaded yet
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1275%252F20421275%252Fdocs_service_history-1774703124933.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac0a23e6641190c01d9bb7b089e8cd7c%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1275/20421275/docs_service_history-1774703124933.jpg?ixlib=js-3.8.0&auto=format&s=ac0a23e6641190c01d9bb7b089e8cd7c not downloaded yet
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_passenger-1774629831866.jpeg> (referer: None)
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_passenger-1774625156328.jpg> (referer: None)
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7361/20487361/instrument_cluster-1774701282398.jpg> (referer: None)
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7361/20487361/interior_front_seats-1774701167663.jpg> (referer: None)
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7361/20487361/interior_boot-1774701258013.jpg> (referer: None)
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_driver-1774624913965.jpg> (referer: None)
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16ee10>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_rear_passenger-1774629831866.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_passenger-1774629831866.jpeg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d26bf10>
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_rear_passenger-1774625156328.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_passenger-1774625156328.jpg saved to cache
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e083f50>
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Finstrument_cluster-1774701282398.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/instrument_cluster-1774701282398.jpg saved to cache
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae5b50>
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7361%252F20487361%252Finterior_front_seats-1774701167663.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7361/20487361/interior_front_seats-1774701167663.jpg saved to cache
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e081790>
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7361%252F20487361%252Finterior_boot-1774701258013.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7361/20487361/interior_boot-1774701258013.jpg saved to cache
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d268910>
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3182%252F20423182%252Fexterior_front_driver-1774624913965.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_driver-1774624913965.jpg saved to cache
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23
2026-03-29 20:16:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70b952e3-1ade-5a84-8d2e-dbffd2316a23, skipping ID generation
2026-03-29 20:16:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 with scrape type 1
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70b952e3-1ade-5a84-8d2e-dbffd2316a23 sending to next pipeline
2026-03-29 20:16:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 70b952e3-1ade-5a84-8d2e-dbffd2316a23, identifier: 20423182
2026-03-29 20:16:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 70b952e3-1ade-5a84-8d2e-dbffd2316a23 with identifier: 20423182
2026-03-29 20:16:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 70b952e3-1ade-5a84-8d2e-dbffd2316a23 with identifier: 20423182
2026-03-29 20:16:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 70b952e3-1ade-5a84-8d2e-dbffd2316a23 with identifier: 20423182 to the API
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_driver-1774624913965.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '70b952e3-1ade-5a84-8d2e-dbffd2316a23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EF17 DFJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20423182',
'listing': 'auction',
'location': 'Greater London Purley',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 35300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2644703,
'Height': 2934,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_driver-1774624913965.jpg',
'Width': 3912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2358371,
'Height': 2879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_driver-1774625124362.jpg',
'Width': 3839},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2308065,
'Height': 2943,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_front_passenger-1774625027219.jpg',
'Width': 3924},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2354100,
'Height': 2837,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3182/20423182/exterior_rear_passenger-1774625156328.jpg',
'Width': 3783},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b952e3-1ade-5a84-8d2e-dbffd2316a23/70b952e3-1ade-5a84-8d2e-dbffd2316a23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3831833,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3182/20423182/interior_rear_seats-1774625540085.jpg',
'Width': 4032}],
'price': 9099,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match Edition TSI S-A',
'transmission': 'automatic',
'trim': 'Match Edition TSI S-A',
'vin': 'WVWZZZ6RZHU062672',
'year': 2017}
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423182%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Saving data for 20423182: {'created_time': 1774815380.394015, 'last_price_update_time': 1774815380.394029, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20423182') HTTP/1.1" 204 0
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=216&page=6&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 71867087-b9b1-5ea1-9251-61d118905020 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 71867087-b9b1-5ea1-9251-61d118905020 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20487615
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20488394
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488394%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20488394: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20464062
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20134898
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19440586
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19452010
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 10749345
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19842266
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20386031
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386031%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20386031: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20499683
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499683%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20499683: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20118034
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20172802
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20497223
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19286556
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20489789
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 12967935
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20254078
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 7263451
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 18322763
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20406653
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20490670
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20502991
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20372589
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20158404
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 18562849
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718562849%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 18562849: 1
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20098323.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20417323
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417323%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20417323: 1
2026-03-29 20:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20485001
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20303214
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303214%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20303214: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20459750
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20491811
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20475595
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20127568
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19344017
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20260509
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20189241
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 12732265
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19360225.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20341600.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 with identifier: 20098323
2026-03-29 20:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 with scrape type 1
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_front_driver-1774543595137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_driver-1774543595137.jpg not downloaded yet
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_rear_driver-1774543605111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_rear_driver-1774543605111.jpg not downloaded yet
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_front_passenger-1774543633993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_passenger-1774543633993.jpg not downloaded yet
2026-03-29 20:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68165082-83ca-5f7a-8889-0cbf88a844ec with identifier: 19360225
2026-03-29 20:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68165082-83ca-5f7a-8889-0cbf88a844ec with scrape type 1
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_front_driver-1770814503337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_driver-1770814503337.jpg not downloaded yet
2026-03-29 20:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a141c4-47aa-5364-a8af-623edf909def with identifier: 20341600
2026-03-29 20:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a141c4-47aa-5364-a8af-623edf909def with scrape type 1
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9a141c4-47aa-5364-a8af-623edf909def
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Fexterior_front_driver-1774000363948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_front_driver-1774000363948.jpg not downloaded yet
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_rear_passenger-1774543615692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_rear_passenger-1774543615692.jpg not downloaded yet
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_rear_driver-1770814521391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_rear_driver-1770814521391.jpg not downloaded yet
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Fexterior_rear_driver-1774008817927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_rear_driver-1774008817927.jpg not downloaded yet
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F20098323%252Finterior_front_seats-1774543960685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/20098323/interior_front_seats-1774543960685.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_front_passenger-1770814544941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_passenger-1770814544941.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Fexterior_front_passenger-1774000436757.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_front_passenger-1774000436757.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F20098323%252Finterior_rear_seats-1774543979833.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/20098323/interior_rear_seats-1774543979833.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_rear_passenger-1770814534789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_rear_passenger-1770814534789.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Fexterior_rear_passenger-1774000415112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_rear_passenger-1774000415112.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Finterior_dashboard-1774544062536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/interior_dashboard-1774544062536.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0225%252F19360225%252Finterior_front_seats-1770815142493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0225/19360225/interior_front_seats-1770815142493.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1600%252F20341600%252Finterior_front_seats-1774000824035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1600/20341600/interior_front_seats-1774000824035.jpg already downloaded
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Finterior_dashboard-1774000859266.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/interior_dashboard-1774000859266.jpg already downloaded
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1600%252F20341600%252Finterior_boot-1774000928074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1600/20341600/interior_boot-1774000928074.jpg already downloaded
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1600%252F20341600%252Fdocs_service_history-1774008598517.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0eb1e31bbd8030c022f6cb4e4488e447%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1600/20341600/docs_service_history-1774008598517.jpg?ixlib=js-3.8.0&auto=format&s=0eb1e31bbd8030c022f6cb4e4488e447 not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Finstrument_cluster-1774544067539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/instrument_cluster-1774544067539.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0225%252F19360225%252Finterior_rear_seats-1770815166943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0225/19360225/interior_rear_seats-1770815166943.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1600%252F20341600%252Fdocs_service_history-1774008632472.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfd9bbfb6916ed7b0d59eb962209e68b2%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1600/20341600/docs_service_history-1774008632472.jpg?ixlib=js-3.8.0&auto=format&s=fd9bbfb6916ed7b0d59eb962209e68b2 not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8323%252F20098323%252Finterior_boot-1774544046653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8323/20098323/interior_boot-1774544046653.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Finterior_dashboard-1770815207646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/interior_dashboard-1770815207646.jpg not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1600%252F20341600%252Fdamage_scratches-1774000477301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1600/20341600/damage_scratches-1774000477301.jpg already downloaded
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_driver-1774533063390.jpg> (referer: None)
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8323%252F20098323%252Fdocs_service_history-1774544742089.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e3ef3c4fa5869075a609e83828bd577%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8323/20098323/docs_service_history-1774544742089.jpg?ixlib=js-3.8.0&auto=format&s=5e3ef3c4fa5869075a609e83828bd577 not downloaded yet
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0225%252F19360225%252Finterior_boot-1770815231935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0225/19360225/interior_boot-1770815231935.jpg not downloaded yet
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1275/20421275/instrument_cluster-1774533711030.jpg> (referer: None)
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0225%252F19360225%252Fdamage_windscreen-1774703507482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0225/19360225/damage_windscreen-1774703507482.jpg not downloaded yet
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_passenger-1774533067814.jpg> (referer: None)
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fwheels_front_driver-1770814751880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/wheels_front_driver-1770814751880.jpg not downloaded yet
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1275/20421275/interior_front_seats-1774533820759.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_front_passenger-1774533068501.jpg> (referer: None)
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2bfc90>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_rear_driver-1774533063390.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_driver-1774533063390.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1275/20421275/interior_rear_seats-1774533721905.jpg> (referer: None)
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03e2d0>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Finstrument_cluster-1774533711030.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/instrument_cluster-1774533711030.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d052e10>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_rear_passenger-1774533067814.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_passenger-1774533067814.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 71867087-b9b1-5ea1-9251-61d118905020 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 71867087-b9b1-5ea1-9251-61d118905020 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7267eea1-fa38-5f52-b069-269a46f5babb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7267eea1-fa38-5f52-b069-269a46f5babb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacd590>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1275%252F20421275%252Finterior_front_seats-1774533820759.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1275/20421275/interior_front_seats-1774533820759.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec67090>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1275%252F20421275%252Fexterior_front_passenger-1774533068501.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_front_passenger-1774533068501.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacd9d0>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1275%252F20421275%252Finterior_rear_seats-1774533721905.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1275/20421275/interior_rear_seats-1774533721905.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71867087-b9b1-5ea1-9251-61d118905020
2026-03-29 20:16:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71867087-b9b1-5ea1-9251-61d118905020, skipping ID generation
2026-03-29 20:16:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71867087-b9b1-5ea1-9251-61d118905020 with scrape type 1
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71867087-b9b1-5ea1-9251-61d118905020 sending to next pipeline
2026-03-29 20:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 71867087-b9b1-5ea1-9251-61d118905020, identifier: 20421275
2026-03-29 20:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 71867087-b9b1-5ea1-9251-61d118905020 with identifier: 20421275
2026-03-29 20:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 71867087-b9b1-5ea1-9251-61d118905020 with identifier: 20421275
2026-03-29 20:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 71867087-b9b1-5ea1-9251-61d118905020 with identifier: 20421275 to the API
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1275/20421275/interior_rear_seats-1774533721905.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '71867087-b9b1-5ea1-9251-61d118905020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'X66 JSA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20421275',
'listing': 'auction',
'location': 'Slough Slough',
'make': 'Lexus',
'model': 'UX 250H',
'odometer': 15165,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627582,
'Height': 2266,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_driver-1774533063390.jpg',
'Width': 3021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650547,
'Height': 2698,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_front_passenger-1774533068501.jpg',
'Width': 3597},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1327086,
'Height': 2344,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1275/20421275/exterior_rear_passenger-1774533067814.jpg',
'Width': 3125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1798224,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1275/20421275/interior_front_seats-1774533820759.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2091374,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1275/20421275/interior_rear_seats-1774533721905.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71867087-b9b1-5ea1-9251-61d118905020/71867087-b9b1-5ea1-9251-61d118905020_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1330168,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1275/20421275/instrument_cluster-1774533711030.jpg',
'Width': 3840}],
'price': 20250,
'price_includes_vat': False,
'registration_date': '2023-03-05',
'seats_number': None,
'seller_name': None,
'title': 'Lexus UX 250H 4X2 CVT',
'transmission': 'automatic',
'trim': '4X2 CVT',
'vin': 'JTHY65BH602142437',
'year': 2023}
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421275%27 HTTP/1.1" 200 None
2026-03-29 20:16:22 [motorway.uk] INFO: Saving data for 20421275: {'created_time': 1774815382.827131, 'last_price_update_time': 1774815382.82714, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20421275') HTTP/1.1" 204 0
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 68165082-83ca-5f7a-8889-0cbf88a844ec due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19384929.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8323/20098323/interior_dashboard-1774544062536.jpg> (referer: None)
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0225/19360225/interior_dashboard-1770815207646.jpg> (referer: None)
2026-03-29 20:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff5cca57-3ea9-5ed8-bea0-a44092156141 with identifier: 19384929
2026-03-29 20:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5cca57-3ea9-5ed8-bea0-a44092156141 with scrape type 1
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_front_driver-1774635220281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_driver-1774635220281.jpg not downloaded yet
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_rear_driver-1774635230121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_driver-1774635230121.jpg not downloaded yet
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_front_passenger-1774635252429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_passenger-1774635252429.jpg not downloaded yet
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_rear_passenger-1774635242854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_passenger-1774635242854.jpg not downloaded yet
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d321510>
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Finterior_dashboard-1774544062536.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/interior_dashboard-1774544062536.jpg saved to cache
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4929%252F19384929%252Finterior_front_seats-1774635796049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4929/19384929/interior_front_seats-1774635796049.jpg not downloaded yet
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4929%252F19384929%252Finterior_rear_seats-1774635587853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4929/19384929/interior_rear_seats-1774635587853.jpg not downloaded yet
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=252&page=7&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4929%252F19384929%252Finterior_dashboard-1774682204062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4929/19384929/interior_dashboard-1774682204062.jpg not downloaded yet
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c245690>
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Finterior_dashboard-1770815207646.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/interior_dashboard-1770815207646.jpg saved to cache
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Finstrument_cluster-1774635792654.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/instrument_cluster-1774635792654.jpg not downloaded yet
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20471425
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20460179
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460179%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 20460179: 1
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4929%252F19384929%252Finterior_boot-1774635621694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4929/19384929/interior_boot-1774635621694.jpg not downloaded yet
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20486036
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20484858
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20485204
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20487941
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487941%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 20487941: 1
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4929%252F19384929%252Fdocs_service_history-1774635688345.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D42fd93c6ea51377db2008cd3bb07cfca%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4929/19384929/docs_service_history-1774635688345.jpg?ixlib=js-3.8.0&auto=format&s=42fd93c6ea51377db2008cd3bb07cfca not downloaded yet
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20364057
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20486965
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20137059
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20074064
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720074064%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 20074064: 1
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0225/19360225/interior_rear_seats-1770815166943.jpg> (referer: None)
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0225/19360225/wheels_front_driver-1770814751880.jpg> (referer: None)
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20211024
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 15623720
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 3788757
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20490856
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 3629062
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 17539370
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 19374986
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 8230018
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278230018%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 8230018: 1
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20417498
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20493011
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 19185609
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20459030
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 19077638
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 11018452
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20107109
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720107109%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 20107109: 1
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 19998396
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20254074
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254074%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 20254074: 1
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8323/20098323/instrument_cluster-1774544067539.jpg> (referer: None)
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20487479
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487479%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 20487479: 1
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 20436997
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 12193651
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712193651%27 HTTP/1.1" 200 None
2026-03-29 20:16:23 [motorway.uk] INFO: Scrape type for 12193651: 1
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 12187861
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 13059915
2026-03-29 20:16:23 [motorway.uk] INFO: Found listing with ID: 16021572
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716021572%27 HTTP/1.1" 200 None
2026-03-29 20:16:24 [motorway.uk] INFO: Scrape type for 16021572: 2
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d547410>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0225%252F19360225%252Finterior_rear_seats-1770815166943.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0225/19360225/interior_rear_seats-1770815166943.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca70150>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fwheels_front_driver-1770814751880.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/wheels_front_driver-1770814751880.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:24 [motorway.uk] INFO: Found listing with ID: 20368083
2026-03-29 20:16:24 [motorway.uk] INFO: Found listing with ID: 20499187
2026-03-29 20:16:24 [motorway.uk] INFO: Found listing with ID: 11654403
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbea2d0>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Finstrument_cluster-1774544067539.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/instrument_cluster-1774544067539.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c9a141c4-47aa-5364-a8af-623edf909def due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c9a141c4-47aa-5364-a8af-623edf909def due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c9a141c4-47aa-5364-a8af-623edf909def due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 68165082-83ca-5f7a-8889-0cbf88a844ec due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 68165082-83ca-5f7a-8889-0cbf88a844ec due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c9a141c4-47aa-5364-a8af-623edf909def due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_passenger-1770814544941.jpg> (referer: None)
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0225/19360225/interior_boot-1770815231935.jpg> (referer: None)
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed78390>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_front_passenger-1770814544941.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_passenger-1770814544941.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a4650>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0225%252F19360225%252Finterior_boot-1770815231935.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0225/19360225/interior_boot-1770815231935.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4929/19384929/interior_boot-1774635621694.jpg> (referer: None)
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item ff5cca57-3ea9-5ed8-bea0-a44092156141 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa6810>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4929%252F19384929%252Finterior_boot-1774635621694.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4929/19384929/interior_boot-1774635621694.jpg saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4929/19384929/instrument_cluster-1774635792654.jpg> (referer: None)
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4929/19384929/interior_front_seats-1774635796049.jpg> (referer: None)
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d250e10>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Finstrument_cluster-1774635792654.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/instrument_cluster-1774635792654.jpg saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8dc50>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4929%252F19384929%252Finterior_front_seats-1774635796049.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4929/19384929/interior_front_seats-1774635796049.jpg saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item ff5cca57-3ea9-5ed8-bea0-a44092156141 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_passenger-1774635252429.jpg> (referer: None)
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_passenger-1774635242854.jpg> (referer: None)
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec1e250>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_front_passenger-1774635252429.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_passenger-1774635252429.jpg saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa4fd0>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_rear_passenger-1774635242854.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_passenger-1774635242854.jpg saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20303214.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_driver-1774635230121.jpg> (referer: None)
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_driver-1774635220281.jpg> (referer: None)
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item ff5cca57-3ea9-5ed8-bea0-a44092156141 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518d050b-60b8-597e-b17b-2d9658a2f54d with identifier: 20303214
2026-03-29 20:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518d050b-60b8-597e-b17b-2d9658a2f54d with scrape type 1
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_front_driver-1774711020468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_front_driver-1774711020468.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_rear_driver-1774711086415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_driver-1774711086415.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_front_passenger-1774711061189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_front_passenger-1774711061189.jpg not downloaded yet
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e06c2d0>
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_rear_driver-1774635230121.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_driver-1774635230121.jpg saved to cache
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58fc10>
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4929%252F19384929%252Fexterior_front_driver-1774635220281.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_driver-1774635220281.jpg saved to cache
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff5cca57-3ea9-5ed8-bea0-a44092156141
2026-03-29 20:16:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff5cca57-3ea9-5ed8-bea0-a44092156141, skipping ID generation
2026-03-29 20:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5cca57-3ea9-5ed8-bea0-a44092156141 with scrape type 1
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff5cca57-3ea9-5ed8-bea0-a44092156141 sending to next pipeline
2026-03-29 20:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ff5cca57-3ea9-5ed8-bea0-a44092156141, identifier: 19384929
2026-03-29 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_rear_driver-1774008817927.jpg> (referer: None)
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_rear_passenger-1774711046486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_passenger-1774711046486.jpg not downloaded yet
2026-03-29 20:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ff5cca57-3ea9-5ed8-bea0-a44092156141 with identifier: 19384929
2026-03-29 20:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ff5cca57-3ea9-5ed8-bea0-a44092156141 with identifier: 19384929
2026-03-29 20:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ff5cca57-3ea9-5ed8-bea0-a44092156141 with identifier: 19384929 to the API
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_driver-1774635220281.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ff5cca57-3ea9-5ed8-bea0-a44092156141',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP21 KTE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19384929',
'listing': 'auction',
'location': 'Surrey Esher',
'make': 'Audi',
'model': 'A1',
'odometer': 26612,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2128401,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_driver-1774635220281.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1396309,
'Height': 2207,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_driver-1774635230121.jpg',
'Width': 2942},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1178898,
'Height': 2035,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_front_passenger-1774635252429.jpg',
'Width': 2713},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1280681,
'Height': 2154,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4929/19384929/exterior_rear_passenger-1774635242854.jpg',
'Width': 2872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938227,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4929/19384929/interior_front_seats-1774635796049.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2283294,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4929/19384929/instrument_cluster-1774635792654.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5cca57-3ea9-5ed8-bea0-a44092156141/ff5cca57-3ea9-5ed8-bea0-a44092156141_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3362879,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4929/19384929/interior_boot-1774635621694.jpg',
'Width': 4032}],
'price': 11827,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Technik 25 TFSI',
'transmission': 'manual',
'trim': 'Technik 25 TFSI',
'vin': 'WAUZZZGB2MR051961',
'year': 2021}
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719384929%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Saving data for 19384929: {'created_time': 1774815387.047416, 'last_price_update_time': 1774815387.047426, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19384929') HTTP/1.1" 204 0
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3214%252F20303214%252Finterior_front_seats-1774711520980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3214/20303214/interior_front_seats-1774711520980.jpg not downloaded yet
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=288&page=8&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02fe90>
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a141c4-47aa-5364-a8af-623edf909def/c9a141c4-47aa-5364-a8af-623edf909def_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Fexterior_rear_driver-1774008817927.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_rear_driver-1774008817927.jpg saved to cache
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9a141c4-47aa-5364-a8af-623edf909def
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3214%252F20303214%252Finterior_rear_seats-1774711863400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3214/20303214/interior_rear_seats-1774711863400.jpg not downloaded yet
2026-03-29 20:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Finterior_dashboard-1774711565209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/interior_dashboard-1774711565209.jpg not downloaded yet
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Finstrument_cluster-1774711598185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/instrument_cluster-1774711598185.jpg not downloaded yet
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20470032
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19734640
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20455021
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20237507
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720237507%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20237507: 1
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3214%252F20303214%252Finterior_boot-1774711572898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3214/20303214/interior_boot-1774711572898.jpg not downloaded yet
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20489983
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20393410
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19840923
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20462094
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462094%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20462094: 1
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3214%252F20303214%252Fdocs_service_history-1774713297290.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92dcc21cf6bcdec7bfd080fc24c096aa%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3214/20303214/docs_service_history-1774713297290.jpg?ixlib=js-3.8.0&auto=format&s=92dcc21cf6bcdec7bfd080fc24c096aa not downloaded yet
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 16271814
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 16318590
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20487406
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487406%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20487406: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19679688
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 16422959
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20496326
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 14326949
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20457094
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457094%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20457094: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20453358
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453358%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20453358: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19940066
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 13623460
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19930182
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19899454
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19785042
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719785042%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 19785042: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 18874288
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718874288%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 18874288: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20490925
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 8725249
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278725249%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 8725249: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20487634
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487634%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20487634: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20485866
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20387201
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387201%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20387201: 1
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 18839860
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 17987243
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 14223294
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714223294%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 14223294: 1
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_front_driver-1774000363948.jpg> (referer: None)
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20439498
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20130616
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720130616%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 20130616: 1
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12193651.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_rear_driver-1770814521391.jpg> (referer: None)
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19164973
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719164973%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [motorway.uk] INFO: Scrape type for 19164973: 1
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16021572.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 19699947
2026-03-29 20:16:27 [motorway.uk] INFO: Found listing with ID: 20316056
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_driver-1770814503337.jpg> (referer: None)
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11a510>
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9a141c4-47aa-5364-a8af-623edf909def/c9a141c4-47aa-5364-a8af-623edf909def_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1600%252F20341600%252Fexterior_front_driver-1774000363948.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_front_driver-1774000363948.jpg saved to cache
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9a141c4-47aa-5364-a8af-623edf909def
2026-03-29 20:16:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9a141c4-47aa-5364-a8af-623edf909def, skipping ID generation
2026-03-29 20:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a141c4-47aa-5364-a8af-623edf909def with scrape type 1
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9a141c4-47aa-5364-a8af-623edf909def sending to next pipeline
2026-03-29 20:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c9a141c4-47aa-5364-a8af-623edf909def, identifier: 20341600
2026-03-29 20:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c9a141c4-47aa-5364-a8af-623edf909def with identifier: 20341600
2026-03-29 20:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c9a141c4-47aa-5364-a8af-623edf909def with identifier: 20341600
2026-03-29 20:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c9a141c4-47aa-5364-a8af-623edf909def with identifier: 20341600 to the API
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_front_driver-1774000363948.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c9a141c4-47aa-5364-a8af-623edf909def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK66 EOF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20341600',
'listing': 'auction',
'location': 'Suffolk Sudbury',
'make': 'Mercedes',
'model': 'SLC',
'odometer': 25200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a141c4-47aa-5364-a8af-623edf909def/c9a141c4-47aa-5364-a8af-623edf909def_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1894387,
'Height': 2912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_front_driver-1774000363948.jpg',
'Width': 3883},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9a141c4-47aa-5364-a8af-623edf909def/c9a141c4-47aa-5364-a8af-623edf909def_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1524451,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1600/20341600/exterior_rear_driver-1774008817927.jpg',
'Width': 3702},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4/1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4087867,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1600/20341600/interior_front_seats-1774000824035.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4/1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3712693,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1600/20341600/interior_dashboard-1774000859266.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4/1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3633316,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1600/20341600/interior_boot-1774000928074.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4/1ac5204a-0d9c-558f-8aae-0beb3c7a1fe4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1429702,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1600/20341600/damage_scratches-1774000477301.jpg',
'Width': 4032}],
'price': 12399,
'price_includes_vat': False,
'registration_date': '2016-12-29',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes SLC 200 Sport',
'transmission': 'manual',
'trim': '200 Sport',
'vin': 'WDD1724342F139392',
'year': 2016}
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720341600%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [motorway.uk] INFO: Saving data for 20341600: {'created_time': 1774815388.406094, 'last_price_update_time': 1774815388.406104, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20341600') HTTP/1.1" 204 0
2026-03-29 20:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95796fb5-89be-5bf4-a333-a215b1be4601 with identifier: 12193651
2026-03-29 20:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95796fb5-89be-5bf4-a333-a215b1be4601 with scrape type 1
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_front_driver-1774706215425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_driver-1774706215425.jpg not downloaded yet
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1b6cd0>
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_rear_driver-1770814521391.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_rear_driver-1770814521391.jpg saved to cache
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3e30c5a-7a99-5687-9dc6-6f0cbec5c149 with identifier: 16021572
2026-03-29 20:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3e30c5a-7a99-5687-9dc6-6f0cbec5c149 with scrape type 2
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3e30c5a-7a99-5687-9dc6-6f0cbec5c149 with scrape type 2
2026-03-29 20:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e3e30c5a-7a99-5687-9dc6-6f0cbec5c149, identifier: 16021572
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadf050>
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0225%252F19360225%252Fexterior_front_driver-1770814503337.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_driver-1770814503337.jpg saved to cache
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68165082-83ca-5f7a-8889-0cbf88a844ec
2026-03-29 20:16:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68165082-83ca-5f7a-8889-0cbf88a844ec, skipping ID generation
2026-03-29 20:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68165082-83ca-5f7a-8889-0cbf88a844ec with scrape type 1
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68165082-83ca-5f7a-8889-0cbf88a844ec sending to next pipeline
2026-03-29 20:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 68165082-83ca-5f7a-8889-0cbf88a844ec, identifier: 19360225
2026-03-29 20:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e3e30c5a-7a99-5687-9dc6-6f0cbec5c149 with identifier: 16021572
2026-03-29 20:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e3e30c5a-7a99-5687-9dc6-6f0cbec5c149 with identifier: 16021572
2026-03-29 20:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e3e30c5a-7a99-5687-9dc6-6f0cbec5c149 with identifier: 16021572 to the API
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16021572.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e3e30c5a-7a99-5687-9dc6-6f0cbec5c149',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S10 KDW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16021572',
'listing': 'auction',
'location': 'West Yorkshire Brighouse',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 25410,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 18000,
'price_includes_vat': False,
'registration_date': '2019-07-26',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE Portfolio AWD D Auto',
'transmission': 'automatic',
'trim': 'Portfolio AWD D Auto',
'vin': 'SADCA2AN5KA613989',
'year': 2019}
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716021572%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [motorway.uk] INFO: Saving data for 16021572: {'auction_closing_time': 1774884600.0, 'created_time': 1774557502.072995, 'last_price_update_time': 1774815389.368667}
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16021572') HTTP/1.1" 204 0
2026-03-29 20:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 68165082-83ca-5f7a-8889-0cbf88a844ec with identifier: 19360225
2026-03-29 20:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 68165082-83ca-5f7a-8889-0cbf88a844ec with identifier: 19360225
2026-03-29 20:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 68165082-83ca-5f7a-8889-0cbf88a844ec with identifier: 19360225 to the API
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_driver-1770814503337.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '68165082-83ca-5f7a-8889-0cbf88a844ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BV24 JWO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19360225',
'listing': 'auction',
'location': 'Warwickshire Warwick',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 14393,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2290337,
'Height': 2541,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_driver-1770814503337.jpg',
'Width': 3388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2072081,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_rear_driver-1770814521391.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421543,
'Height': 2466,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0225/19360225/exterior_front_passenger-1770814544941.jpg',
'Width': 3288},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3953001,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0225/19360225/interior_rear_seats-1770815166943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2294119,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0225/19360225/interior_dashboard-1770815207646.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4634269,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0225/19360225/interior_boot-1770815231935.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68165082-83ca-5f7a-8889-0cbf88a844ec/68165082-83ca-5f7a-8889-0cbf88a844ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1822033,
'Height': 2336,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0225/19360225/wheels_front_driver-1770814751880.jpg',
'Width': 3115}],
'price': 27825,
'price_includes_vat': False,
'registration_date': '2024-07-19',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque DYN SE D MHEV A',
'transmission': 'automatic',
'trim': 'Evoque DYN SE D MHEV A',
'vin': 'SALZA2ANXSH266701',
'year': 2024}
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719360225%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [motorway.uk] INFO: Saving data for 19360225: {'created_time': 1774815389.835819, 'last_price_update_time': 1774815389.83583, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19360225') HTTP/1.1" 204 0
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 518d050b-60b8-597e-b17b-2d9658a2f54d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_rear_driver-1774706304313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_driver-1774706304313.jpg not downloaded yet
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_passenger-1774711046486.jpg> (referer: None)
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_front_passenger-1774706382276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_passenger-1774706382276.jpg not downloaded yet
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8230018.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_rear_passenger-1774706385343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_passenger-1774706385343.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3651%252F12193651%252Finterior_front_seats-1774448360475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3651/12193651/interior_front_seats-1774448360475.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3651%252F12193651%252Finterior_rear_seats-1774448367219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3651/12193651/interior_rear_seats-1774448367219.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Finterior_dashboard-1774706394271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/interior_dashboard-1774706394271.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3651%252F12193651%252Finterior_boot-1774706383692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3651/12193651/interior_boot-1774706383692.jpg not downloaded yet
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2bb950>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_rear_passenger-1774711046486.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_passenger-1774711046486.jpg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3651%252F12193651%252Fdocs_service_history-1774440832171.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De4213c3c4ce6411cc35f071b0e152afe%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3651/12193651/docs_service_history-1774440832171.jpg?ixlib=js-3.8.0&auto=format&s=e4213c3c4ce6411cc35f071b0e152afe not downloaded yet
2026-03-29 20:16:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49f37c9-fe8a-581e-87bc-008461cd1467 with identifier: 8230018
2026-03-29 20:16:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49f37c9-fe8a-581e-87bc-008461cd1467 with scrape type 1
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_front_driver-1774692498419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_driver-1774692498419.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3651%252F12193651%252Fdocs_service_history-1774440832377.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba47fe71ea73b6532225783d596f956e%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3651/12193651/docs_service_history-1774440832377.jpg?ixlib=js-3.8.0&auto=format&s=ba47fe71ea73b6532225783d596f956e not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_rear_driver-1774692518410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_driver-1774692518410.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_front_passenger-1774692530423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_passenger-1774692530423.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_rear_passenger-1774692508748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_passenger-1774692508748.jpg not downloaded yet
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3214/20303214/interior_front_seats-1774711520980.jpg> (referer: None)
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F8230018%252Finterior_front_seats-1774693819704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/8230018/interior_front_seats-1774693819704.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F8230018%252Finterior_rear_seats-1774693837585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/8230018/interior_rear_seats-1774693837585.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Finterior_dashboard-1774693852820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/interior_dashboard-1774693852820.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Finstrument_cluster-1774693803157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/instrument_cluster-1774693803157.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F8230018%252Finterior_boot-1774693810191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/8230018/interior_boot-1774693810191.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0018%252F8230018%252Fdocs_service_history-1774694206601.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9026341c289c3ba7a2333925232c7bf1%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0018/8230018/docs_service_history-1774694206601.jpg?ixlib=js-3.8.0&auto=format&s=9026341c289c3ba7a2333925232c7bf1 not downloaded yet
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_driver-1774706215425.jpg> (referer: None)
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13c310>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3214%252F20303214%252Finterior_front_seats-1774711520980.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3214/20303214/interior_front_seats-1774711520980.jpg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacb290>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_front_driver-1774706215425.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_driver-1774706215425.jpg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_driver-1774706304313.jpg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_passenger-1774692508748.jpg> (referer: None)
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d29f410>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_rear_driver-1774706304313.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_driver-1774706304313.jpg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d29e950>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_rear_passenger-1774692508748.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_passenger-1774692508748.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/8230018/interior_boot-1774693810191.jpg> (referer: None)
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/8230018/instrument_cluster-1774693803157.jpg> (referer: None)
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea66950>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F8230018%252Finterior_boot-1774693810191.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/8230018/interior_boot-1774693810191.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d039690>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Finstrument_cluster-1774693803157.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/instrument_cluster-1774693803157.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/8230018/interior_dashboard-1774693852820.jpg> (referer: None)
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c690790>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Finterior_dashboard-1774693852820.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/interior_dashboard-1774693852820.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/8230018/interior_rear_seats-1774693837585.jpg> (referer: None)
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0018/8230018/interior_front_seats-1774693819704.jpg> (referer: None)
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13d750>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F8230018%252Finterior_rear_seats-1774693837585.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/8230018/interior_rear_seats-1774693837585.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item d49f37c9-fe8a-581e-87bc-008461cd1467 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03a010>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0018%252F8230018%252Finterior_front_seats-1774693819704.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0018/8230018/interior_front_seats-1774693819704.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_driver-1774692518410.jpg> (referer: None)
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_passenger-1774692530423.jpg> (referer: None)
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6a9910>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_rear_driver-1774692518410.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_driver-1774692518410.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac8a10>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_front_passenger-1774692530423.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_passenger-1774692530423.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_driver-1774692498419.jpg> (referer: None)
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03ae10>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0018%252F8230018%252Fexterior_front_driver-1774692498419.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_driver-1774692498419.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d49f37c9-fe8a-581e-87bc-008461cd1467
2026-03-29 20:16:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d49f37c9-fe8a-581e-87bc-008461cd1467, skipping ID generation
2026-03-29 20:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49f37c9-fe8a-581e-87bc-008461cd1467 with scrape type 1
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d49f37c9-fe8a-581e-87bc-008461cd1467 sending to next pipeline
2026-03-29 20:16:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d49f37c9-fe8a-581e-87bc-008461cd1467, identifier: 8230018
2026-03-29 20:16:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d49f37c9-fe8a-581e-87bc-008461cd1467 with identifier: 8230018
2026-03-29 20:16:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d49f37c9-fe8a-581e-87bc-008461cd1467 with identifier: 8230018
2026-03-29 20:16:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d49f37c9-fe8a-581e-87bc-008461cd1467 with identifier: 8230018 to the API
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_driver-1774692498419.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd49f37c9-fe8a-581e-87bc-008461cd1467',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GN68 LOJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8230018',
'listing': 'auction',
'location': 'Surrey Lingfield',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 55900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1262965,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_driver-1774692498419.jpg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1010552,
'Height': 2316,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_driver-1774692518410.jpg',
'Width': 3088},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1023835,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_front_passenger-1774692530423.jpg',
'Width': 3183},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1149983,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/8230018/exterior_rear_passenger-1774692508748.jpg',
'Width': 3594},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1842341,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/8230018/interior_front_seats-1774693819704.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2141982,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/8230018/interior_rear_seats-1774693837585.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1033344,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/8230018/interior_dashboard-1774693852820.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 997226,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0018/8230018/instrument_cluster-1774693803157.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49f37c9-fe8a-581e-87bc-008461cd1467/d49f37c9-fe8a-581e-87bc-008461cd1467_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1589690,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0018/8230018/interior_boot-1774693810191.jpg',
'Width': 3840}],
'price': 15231,
'price_includes_vat': False,
'registration_date': '2018-10-20',
'seats_number': None,
'seller_name': None,
'title': 'Alfa Romeo Giulia Veloce TB Auto',
'transmission': 'automatic',
'trim': 'Veloce TB Auto',
'vin': 'ZAREAELN5K7599310',
'year': 2018}
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278230018%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [motorway.uk] INFO: Saving data for 8230018: {'created_time': 1774815393.285067, 'last_price_update_time': 1774815393.285078, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8230018') HTTP/1.1" 204 0
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3651/12193651/interior_boot-1774706383692.jpg> (referer: None)
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 95796fb5-89be-5bf4-a333-a215b1be4601 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 95796fb5-89be-5bf4-a333-a215b1be4601 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac90d0>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3651%252F12193651%252Finterior_boot-1774706383692.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3651/12193651/interior_boot-1774706383692.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3651/12193651/interior_dashboard-1774706394271.jpg> (referer: None)
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c693ad0>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Finterior_dashboard-1774706394271.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/interior_dashboard-1774706394271.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_passenger-1774706385343.jpg> (referer: None)
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0b1d0>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_rear_passenger-1774706385343.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_passenger-1774706385343.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460179.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa8cece5-066f-5e3e-aebc-4efd76a9c54f with identifier: 20460179
2026-03-29 20:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f with scrape type 1
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_front_driver-1774545050769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_driver-1774545050769.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_rear_driver-1774545083296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_driver-1774545083296.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_front_passenger-1774545136733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_passenger-1774545136733.jpg not downloaded yet
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_passenger-1774706382276.jpg> (referer: None)
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_rear_passenger-1774545117667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_passenger-1774545117667.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Finterior_front_seats-1774545729110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/interior_front_seats-1774545729110.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Finterior_rear_seats-1774545608635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/interior_rear_seats-1774545608635.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Finterior_dashboard-1774545648755.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/interior_dashboard-1774545648755.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Finterior_boot-1774545722484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/interior_boot-1774545722484.jpg not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0179%252F20460179%252Fdocs_service_history-1774545831840.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df3c6d0150e5fef29736d9e5d6b72000d%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0179/20460179/docs_service_history-1774545831840.jpg?ixlib=js-3.8.0&auto=format&s=f3c6d0150e5fef29736d9e5d6b72000d not downloaded yet
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Fdamage_dents-1774545206006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/damage_dents-1774545206006.jpg not downloaded yet
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e06f410>
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3651%252F12193651%252Fexterior_front_passenger-1774706382276.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_passenger-1774706382276.jpg saved to cache
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95796fb5-89be-5bf4-a333-a215b1be4601
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 95796fb5-89be-5bf4-a333-a215b1be4601 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 95796fb5-89be-5bf4-a333-a215b1be4601 with identifier: 12193651
2026-03-29 20:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 95796fb5-89be-5bf4-a333-a215b1be4601 with identifier: 12193651
2026-03-29 20:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 95796fb5-89be-5bf4-a333-a215b1be4601 with identifier: 12193651 to the API
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:34 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '95796fb5-89be-5bf4-a333-a215b1be4601',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EX66 ZJY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12193651',
'listing': 'auction',
'location': 'Norfolk Norwich',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 45700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_driver-1774706215425.jpg',
'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_driver-1774706304313.jpg',
'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_passenger-1774706382276.jpg',
'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_passenger-1774706385343.jpg',
'https://motorway-photos-modified.imgix.net/3651/12193651/interior_front_seats-1774448360475.jpg',
'https://motorway-photos-modified.imgix.net/3651/12193651/interior_rear_seats-1774448367219.jpg',
'https://motorway-photos-redacted.imgix.net/3651/12193651/interior_dashboard-1774706394271.jpg',
'https://motorway-photos.imgix.net/3651/12193651/interior_boot-1774706383692.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/3651/12193651/docs_service_history-1774440832171.jpg?ixlib=js-3.8.0&auto=format&s=e4213c3c4ce6411cc35f071b0e152afe',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/3651/12193651/docs_service_history-1774440832377.jpg?ixlib=js-3.8.0&auto=format&s=ba47fe71ea73b6532225783d596f956e'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1659500,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_driver-1774706215425.jpg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172143,
'Height': 2842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_driver-1774706304313.jpg',
'Width': 3789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041074,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_front_passenger-1774706382276.jpg',
'Width': 3594},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2119925,
'Height': 2858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3651/12193651/exterior_rear_passenger-1774706385343.jpg',
'Width': 3810},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1853527,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3651/12193651/interior_dashboard-1774706394271.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95796fb5-89be-5bf4-a333-a215b1be4601/95796fb5-89be-5bf4-a333-a215b1be4601_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4016357,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3651/12193651/interior_boot-1774706383692.jpg',
'Width': 4032}],
'price': 16141,
'price_includes_vat': False,
'registration_date': '2016-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Sport HSE Dynam SDV6 A',
'transmission': 'automatic',
'trim': 'Sport HSE Dynam SDV6 A',
'vin': 'SALWA2KE3GA110047',
'year': 2016}
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712193651%27 HTTP/1.1" 200 None
2026-03-29 20:16:34 [motorway.uk] INFO: Saving data for 12193651: {'created_time': 1774815394.920567, 'last_price_update_time': 1774815394.920579, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12193651') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 95796fb5-89be-5bf4-a333-a215b1be4601 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_passenger-1774545136733.jpg> (referer: None)
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0179/20460179/damage_dents-1774545206006.jpg> (referer: None)
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d1110>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_front_passenger-1774545136733.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_passenger-1774545136733.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecf310>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Fdamage_dents-1774545206006.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/damage_dents-1774545206006.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0179/20460179/interior_boot-1774545722484.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0179/20460179/interior_dashboard-1774545648755.jpg> (referer: None)
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c406490>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Finterior_boot-1774545722484.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/interior_boot-1774545722484.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd3dd0>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Finterior_dashboard-1774545648755.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/interior_dashboard-1774545648755.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0179/20460179/interior_front_seats-1774545729110.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0179/20460179/interior_rear_seats-1774545608635.jpg> (referer: None)
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c404d50>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Finterior_front_seats-1774545729110.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/interior_front_seats-1774545729110.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1910>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20460179%252Finterior_rear_seats-1774545608635.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20460179/interior_rear_seats-1774545608635.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_passenger-1774545117667.jpg> (referer: None)
2026-03-29 20:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_driver-1774545083296.jpg> (referer: None)
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf650>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_rear_passenger-1774545117667.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_passenger-1774545117667.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd24d0>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_rear_driver-1774545083296.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_driver-1774545083296.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_driver-1774545050769.jpg> (referer: None)
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecf6d0>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20460179%252Fexterior_front_driver-1774545050769.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_driver-1774545050769.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f
2026-03-29 20:16:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa8cece5-066f-5e3e-aebc-4efd76a9c54f, skipping ID generation
2026-03-29 20:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f with scrape type 1
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa8cece5-066f-5e3e-aebc-4efd76a9c54f sending to next pipeline
2026-03-29 20:16:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa8cece5-066f-5e3e-aebc-4efd76a9c54f, identifier: 20460179
2026-03-29 20:16:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa8cece5-066f-5e3e-aebc-4efd76a9c54f with identifier: 20460179
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue+%26+Black HTTP/1.1" 200 None
2026-03-29 20:16:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:16:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa8cece5-066f-5e3e-aebc-4efd76a9c54f with identifier: 20460179
2026-03-29 20:16:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa8cece5-066f-5e3e-aebc-4efd76a9c54f with identifier: 20460179 to the API
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_driver-1774545050769.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'aa8cece5-066f-5e3e-aebc-4efd76a9c54f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WK74 LBY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20460179',
'listing': 'auction',
'location': 'Hampshire Lymington',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 8725,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2281122,
'Height': 2904,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_driver-1774545050769.jpg',
'Width': 3872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1845900,
'Height': 2669,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_driver-1774545083296.jpg',
'Width': 3558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2389706,
'Height': 2915,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_front_passenger-1774545136733.jpg',
'Width': 3886},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1766106,
'Height': 2588,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0179/20460179/exterior_rear_passenger-1774545117667.jpg',
'Width': 3450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3246077,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0179/20460179/interior_front_seats-1774545729110.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3204950,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0179/20460179/interior_rear_seats-1774545608635.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3591285,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0179/20460179/interior_dashboard-1774545648755.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3385043,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0179/20460179/interior_boot-1774545722484.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8cece5-066f-5e3e-aebc-4efd76a9c54f/aa8cece5-066f-5e3e-aebc-4efd76a9c54f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597788,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0179/20460179/damage_dents-1774545206006.jpg',
'Width': 4032}],
'price': 35573,
'price_includes_vat': False,
'registration_date': '2024-09-27',
'seats_number': None,
'seller_name': None,
'title': 'Toyota RAV4 GR Sport PHEV Auto',
'transmission': 'automatic',
'trim': 'GR Sport PHEV Auto',
'vin': 'JTMGBRFV90D220438',
'year': 2024}
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460179%27 HTTP/1.1" 200 None
2026-03-29 20:16:37 [motorway.uk] INFO: Saving data for 20460179: {'created_time': 1774815397.705275, 'last_price_update_time': 1774815397.705289, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20460179') HTTP/1.1" 204 0
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487941.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99dfe8d-c426-5e62-80f3-c54a89af7f3c with identifier: 20487941
2026-03-29 20:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c with scrape type 1
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_front_driver-1774702435157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_driver-1774702435157.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_rear_driver-1774702464081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_driver-1774702464081.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_front_passenger-1774702486115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_passenger-1774702486115.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_rear_passenger-1774702473778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_passenger-1774702473778.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7941%252F20487941%252Finterior_front_seats-1774703620952.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7941/20487941/interior_front_seats-1774703620952.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7941%252F20487941%252Finterior_rear_seats-1774703644897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7941/20487941/interior_rear_seats-1774703644897.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Finterior_dashboard-1774703736698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/interior_dashboard-1774703736698.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Finstrument_cluster-1774774574128.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/instrument_cluster-1774774574128.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7941%252F20487941%252Finterior_boot-1774703743848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7941/20487941/interior_boot-1774703743848.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7941%252F20487941%252Fdocs_service_history-1774704042471.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df271f0a8c8e6b77d9ed57444f26f24f3%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7941/20487941/docs_service_history-1774704042471.jpg?ixlib=js-3.8.0&auto=format&s=f271f0a8c8e6b77d9ed57444f26f24f3 not downloaded yet
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487479.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20107109.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e66103fd-4730-5591-a0c2-6c4e4070f035 with identifier: 20487479
2026-03-29 20:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e66103fd-4730-5591-a0c2-6c4e4070f035 with scrape type 1
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Fexterior_front_driver-1774706741703.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_front_driver-1774706741703.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Fexterior_rear_driver-1774706738834.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_driver-1774706738834.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7479%252F20487479%252F20487479-exterior_front_passenger-modified-1774709972085.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7479/20487479/20487479-exterior_front_passenger-modified-1774709972085.jpeg not downloaded yet
2026-03-29 20:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d with identifier: 20107109
2026-03-29 20:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d with scrape type 1
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_front_driver-1774706683232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_driver-1774706683232.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Fexterior_rear_passenger-1774706727676.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_passenger-1774706727676.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_rear_driver-1774706710292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_driver-1774706710292.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F20487479%252Finterior_front_seats-1774706909547.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/20487479/interior_front_seats-1774706909547.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_front_passenger-1774706727811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_passenger-1774706727811.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Finterior_dashboard-1774706999720.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/interior_dashboard-1774706999720.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_rear_passenger-1774706713108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_passenger-1774706713108.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Finstrument_cluster-1774709767183.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/instrument_cluster-1774709767183.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20107109%252Finterior_front_seats-1774707307966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20107109/interior_front_seats-1774707307966.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F20487479%252Finterior_boot-1774709601319.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20107109%252Finterior_rear_seats-1774707097133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20107109/interior_rear_seats-1774707097133.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7479%252F20487479%252F20487479-docs_service_history-modified-1774710555376.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D46a9a4e6aeab20e2a3d8f2de44a81555%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7479/20487479/20487479-docs_service_history-modified-1774710555376.jpeg?ixlib=js-3.8.0&auto=format&s=46a9a4e6aeab20e2a3d8f2de44a81555 not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Finterior_dashboard-1774707120446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/interior_dashboard-1774707120446.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F20487479%252Fdamage_scratches-1774707353640.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/20487479/damage_scratches-1774707353640.jpeg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Finstrument_cluster-1774707305581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/instrument_cluster-1774707305581.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20107109%252Finterior_boot-1774707185123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20107109/interior_boot-1774707185123.jpg not downloaded yet
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7109%252F20107109%252Fdocs_service_history-1774707988078.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6cc401f2b29f528ac3a34dbb6418bd4%27 HTTP/1.1" 200 None
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7109/20107109/docs_service_history-1774707988078.jpg?ixlib=js-3.8.0&auto=format&s=b6cc401f2b29f528ac3a34dbb6418bd4 not downloaded yet
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7941/20487941/interior_boot-1774703743848.jpg> (referer: None)
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacf390>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7941%252F20487941%252Finterior_boot-1774703743848.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7941/20487941/interior_boot-1774703743848.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20074064.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca5a4b3-2847-550c-91e1-1105fc56835f with identifier: 20074064
2026-03-29 20:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca5a4b3-2847-550c-91e1-1105fc56835f with scrape type 1
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ca5a4b3-2847-550c-91e1-1105fc56835f
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4064%252F20074064%252Fexterior_front_driver-1774720050813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_front_driver-1774720050813.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4064%252F20074064%252Fexterior_rear_driver-1774720042781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_rear_driver-1774720042781.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4064%252F20074064%252Fexterior_front_passenger-1774776810435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4064/20074064/exterior_front_passenger-1774776810435.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4064%252F20074064%252Fexterior_rear_passenger-1774777088655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4064/20074064/exterior_rear_passenger-1774777088655.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4064%252F20074064%252Finterior_front_seats-1774720785611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4064/20074064/interior_front_seats-1774720785611.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4064%252F20074064%252Finterior_rear_seats-1774720867398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4064/20074064/interior_rear_seats-1774720867398.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4064%252F20074064%252Finterior_dashboard-1774776831929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4064/20074064/interior_dashboard-1774776831929.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4064%252F20074064%252Finterior_boot-1774720639554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4064/20074064/interior_boot-1774720639554.jpg not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4064%252F20074064%252Fdocs_service_history-1774721505937.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D62179b51f88e7e5b64d5742895e7039b%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4064/20074064/docs_service_history-1774721505937.jpg?ixlib=js-3.8.0&auto=format&s=62179b51f88e7e5b64d5742895e7039b not downloaded yet
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4064%252F20074064%252Fdocs_service_history-1774721511881.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De92b100d75a4b721587926753e7054de%27 HTTP/1.1" 200 None
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4064/20074064/docs_service_history-1774721511881.jpg?ixlib=js-3.8.0&auto=format&s=e92b100d75a4b721587926753e7054de not downloaded yet
2026-03-29 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20107109/instrument_cluster-1774707305581.jpg> (referer: None)
2026-03-29 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7109/20107109/interior_boot-1774707185123.jpg> (referer: None)
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c212890>
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Finstrument_cluster-1774707305581.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/instrument_cluster-1774707305581.jpg saved to cache
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c211790>
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20107109%252Finterior_boot-1774707185123.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20107109/interior_boot-1774707185123.jpg saved to cache
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4064/20074064/interior_boot-1774720639554.jpg> (referer: None)
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed79810>
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4064%252F20074064%252Finterior_boot-1774720639554.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4064/20074064/interior_boot-1774720639554.jpg saved to cache
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4064/20074064/interior_rear_seats-1774720867398.jpg> (referer: None)
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa6bd0>
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4064%252F20074064%252Finterior_rear_seats-1774720867398.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4064/20074064/interior_rear_seats-1774720867398.jpg saved to cache
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4064/20074064/interior_front_seats-1774720785611.jpg> (referer: None)
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8ee50>
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4064%252F20074064%252Finterior_front_seats-1774720785611.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4064/20074064/interior_front_seats-1774720785611.jpg saved to cache
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_rear_driver-1774720042781.jpg> (referer: None)
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24df50>
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4064%252F20074064%252Fexterior_rear_driver-1774720042781.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_rear_driver-1774720042781.jpg saved to cache
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_front_driver-1774720050813.jpg> (referer: None)
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed63150>
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4064%252F20074064%252Fexterior_front_driver-1774720050813.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_front_driver-1774720050813.jpg saved to cache
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f
2026-03-29 20:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7479/20487479/damage_scratches-1774707353640.jpeg> (referer: None)
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00f\xf5\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x17\x1a\x00f\xeb\xeb\x00\x00\x00\x00'
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58e810>
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F20487479%252Fdamage_scratches-1774707353640.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/20487479/damage_scratches-1774707353640.jpeg saved to cache
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2ca5a4b3-2847-550c-91e1-1105fc56835f with identifier: 20074064
2026-03-29 20:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2ca5a4b3-2847-550c-91e1-1105fc56835f with identifier: 20074064
2026-03-29 20:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2ca5a4b3-2847-550c-91e1-1105fc56835f with identifier: 20074064 to the API
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:53 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2ca5a4b3-2847-550c-91e1-1105fc56835f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV18 ZFK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20074064',
'listing': 'auction',
'location': 'Hampshire Gosport',
'make': 'Dacia',
'model': 'Duster',
'odometer': 30000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_front_driver-1774720050813.jpg',
'https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_rear_driver-1774720042781.jpg',
'https://motorway-photos-modified.imgix.net/4064/20074064/exterior_front_passenger-1774776810435.jpg',
'https://motorway-photos-modified.imgix.net/4064/20074064/exterior_rear_passenger-1774777088655.jpg',
'https://motorway-photos.imgix.net/4064/20074064/interior_front_seats-1774720785611.jpg',
'https://motorway-photos.imgix.net/4064/20074064/interior_rear_seats-1774720867398.jpg',
'https://motorway-photos-modified.imgix.net/4064/20074064/interior_dashboard-1774776831929.jpg',
'https://motorway-photos.imgix.net/4064/20074064/interior_boot-1774720639554.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/4064/20074064/docs_service_history-1774721505937.jpg?ixlib=js-3.8.0&auto=format&s=62179b51f88e7e5b64d5742895e7039b',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/4064/20074064/docs_service_history-1774721511881.jpg?ixlib=js-3.8.0&auto=format&s=e92b100d75a4b721587926753e7054de'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1130174,
'Height': 2865,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_front_driver-1774720050813.jpg',
'Width': 3820},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 831020,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4064/20074064/exterior_rear_driver-1774720042781.jpg',
'Width': 3398},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1297190,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4064/20074064/interior_front_seats-1774720785611.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1281742,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4064/20074064/interior_rear_seats-1774720867398.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca5a4b3-2847-550c-91e1-1105fc56835f/2ca5a4b3-2847-550c-91e1-1105fc56835f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504632,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4064/20074064/interior_boot-1774720639554.jpg',
'Width': 3840}],
'price': 5137,
'price_includes_vat': False,
'registration_date': '2018-04-12',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Duster AIR SCE 4X2',
'transmission': 'manual',
'trim': 'AIR SCE 4X2',
'vin': 'UU1HSDCVE60028164',
'year': 2018}
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720074064%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Saving data for 20074064: {'created_time': 1774815413.158331, 'last_price_update_time': 1774815413.158342, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20074064') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 2ca5a4b3-2847-550c-91e1-1105fc56835f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20107109/interior_dashboard-1774707120446.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7109/20107109/interior_rear_seats-1774707097133.jpg> (referer: None)
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24c390>
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Finterior_dashboard-1774707120446.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/interior_dashboard-1774707120446.jpg saved to cache
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca35850>
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20107109%252Finterior_rear_seats-1774707097133.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20107109/interior_rear_seats-1774707097133.jpg saved to cache
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item e66103fd-4730-5591-a0c2-6c4e4070f035 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18562849.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:53 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12738572) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg>.
2026-03-29 20:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657b936e-c591-5b19-aebb-9762113c86df with identifier: 18562849
2026-03-29 20:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657b936e-c591-5b19-aebb-9762113c86df with scrape type 1
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 657b936e-c591-5b19-aebb-9762113c86df
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2849%252F18562849%252Fexterior_front_driver-1774691818301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2849/18562849/exterior_front_driver-1774691818301.jpg not downloaded yet
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2849%252F18562849%252Fexterior_rear_driver-1774691839287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2849/18562849/exterior_rear_driver-1774691839287.jpg not downloaded yet
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2849%252F18562849%252Fexterior_front_passenger-1774691867716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2849/18562849/exterior_front_passenger-1774691867716.jpg not downloaded yet
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/20487479/instrument_cluster-1774709767183.jpeg> (referer: None)
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2849%252F18562849%252Fexterior_rear_passenger-1774692027310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2849/18562849/exterior_rear_passenger-1774692027310.jpg not downloaded yet
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2849%252F18562849%252Finterior_front_seats-1772704402812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2849/18562849/interior_front_seats-1772704402812.jpg already downloaded
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2849%252F18562849%252Finterior_rear_seats-1772704414758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2849/18562849/interior_rear_seats-1772704414758.jpg already downloaded
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2849%252F18562849%252Finterior_dashboard-1774691896587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2849/18562849/interior_dashboard-1774691896587.jpg not downloaded yet
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2849%252F18562849%252Finterior_boot-1774691917328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2849/18562849/interior_boot-1774691917328.jpg not downloaded yet
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2849%252F18562849%252Fdocs_service_history-1772704619479.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df6b698bfd438a0b4ee682d93f1f28168%27 HTTP/1.1" 200 None
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2849/18562849/docs_service_history-1772704619479.jpg?ixlib=js-3.8.0&auto=format&s=f6b698bfd438a0b4ee682d93f1f28168 already downloaded
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2849%252F18562849%252Fdocs_service_history-1772704694675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfec97196b95a83be6795664b7a74d2a3%27 HTTP/1.1" 200 None
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2849/18562849/docs_service_history-1772704694675.jpg?ixlib=js-3.8.0&auto=format&s=fec97196b95a83be6795664b7a74d2a3 already downloaded
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x82\ri\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xcc?\x00\x82\x03u\x00\x00\x00\x00'
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13fcd0>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Finstrument_cluster-1774709767183.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/instrument_cluster-1774709767183.jpeg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_passenger-1774706713108.jpg> (referer: None)
2026-03-29 20:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7109/20107109/interior_front_seats-1774707307966.jpg> (referer: None)
2026-03-29 20:16:54 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg>.
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa6890>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_rear_passenger-1774706713108.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_passenger-1774706713108.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28ff10>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20107109%252Finterior_front_seats-1774707307966.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20107109/interior_front_seats-1774707307966.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg> (referer: None)
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbaE\xcc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x1a@\x00\xba;\xd8\x00\x00\x00\x00'
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8ce90>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F20487479%252Finterior_boot-1774709601319.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg saved to cache
2026-03-29 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 657b936e-c591-5b19-aebb-9762113c86df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 657b936e-c591-5b19-aebb-9762113c86df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 657b936e-c591-5b19-aebb-9762113c86df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/20487479/interior_dashboard-1774706999720.jpeg> (referer: None)
2026-03-29 20:16:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 657b936e-c591-5b19-aebb-9762113c86df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c406a10>
2026-03-29 20:16:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Finterior_dashboard-1774706999720.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/interior_dashboard-1774706999720.jpeg saved to cache
2026-03-29 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 657b936e-c591-5b19-aebb-9762113c86df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 657b936e-c591-5b19-aebb-9762113c86df with identifier: 18562849
2026-03-29 20:16:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 657b936e-c591-5b19-aebb-9762113c86df with identifier: 18562849
2026-03-29 20:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 657b936e-c591-5b19-aebb-9762113c86df with identifier: 18562849 to the API
2026-03-29 20:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:58 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '657b936e-c591-5b19-aebb-9762113c86df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST71 LSX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18562849',
'listing': 'auction',
'location': 'Hampshire Gosport',
'make': 'Porsche',
'model': 'Macan',
'odometer': 43000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-modified.imgix.net/2849/18562849/exterior_front_driver-1774691818301.jpg',
'https://motorway-photos-modified.imgix.net/2849/18562849/exterior_rear_driver-1774691839287.jpg',
'https://motorway-photos-modified.imgix.net/2849/18562849/exterior_front_passenger-1774691867716.jpg',
'https://motorway-photos-modified.imgix.net/2849/18562849/exterior_rear_passenger-1774692027310.jpg',
'https://motorway-photos.imgix.net/2849/18562849/interior_front_seats-1772704402812.jpg',
'https://motorway-photos.imgix.net/2849/18562849/interior_rear_seats-1772704414758.jpg',
'https://motorway-photos-modified.imgix.net/2849/18562849/interior_dashboard-1774691896587.jpg',
'https://motorway-photos-modified.imgix.net/2849/18562849/interior_boot-1774691917328.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/2849/18562849/docs_service_history-1772704619479.jpg?ixlib=js-3.8.0&auto=format&s=f6b698bfd438a0b4ee682d93f1f28168',
'https://motorway-service-history-photos.imgix.net/redacted/2849/18562849/docs_service_history-1772704694675.jpg?ixlib=js-3.8.0&auto=format&s=fec97196b95a83be6795664b7a74d2a3'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11c8207-ee76-56e8-87f3-6e5c26251326/f11c8207-ee76-56e8-87f3-6e5c26251326_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3277781,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2849/18562849/interior_front_seats-1772704402812.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11c8207-ee76-56e8-87f3-6e5c26251326/f11c8207-ee76-56e8-87f3-6e5c26251326_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2938618,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2849/18562849/interior_rear_seats-1772704414758.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11c8207-ee76-56e8-87f3-6e5c26251326/f11c8207-ee76-56e8-87f3-6e5c26251326_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1319791,
'Height': 2019,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/2849/18562849/docs_service_history-1772704619479.jpg?ixlib=js-3.8.0&auto=format&s=f6b698bfd438a0b4ee682d93f1f28168',
'Width': 2205},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11c8207-ee76-56e8-87f3-6e5c26251326/f11c8207-ee76-56e8-87f3-6e5c26251326_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1618217,
'Height': 2114,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/2849/18562849/docs_service_history-1772704694675.jpg?ixlib=js-3.8.0&auto=format&s=fec97196b95a83be6795664b7a74d2a3',
'Width': 2349}],
'price': 40575,
'price_includes_vat': False,
'registration_date': '2021-12-02',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S S-A',
'transmission': 'automatic',
'trim': 'S S-A',
'vin': 'WP1ZZZ95ZNLB31961',
'year': 2021}
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718562849%27 HTTP/1.1" 200 None
2026-03-29 20:16:58 [motorway.uk] INFO: Saving data for 18562849: {'created_time': 1774815418.380133, 'last_price_update_time': 1774815418.380143, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18562849') HTTP/1.1" 204 0
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 657b936e-c591-5b19-aebb-9762113c86df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_passenger-1774706727811.jpg> (referer: None)
2026-03-29 20:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7479/20487479/interior_front_seats-1774706909547.jpeg> (referer: None)
2026-03-29 20:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_driver-1774706710292.jpg> (referer: None)
2026-03-29 20:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_passenger-1774706727676.jpeg> (referer: None)
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadded0>
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_front_passenger-1774706727811.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_passenger-1774706727811.jpg saved to cache
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00tK\xf6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\x1f\xf0\x00tB\x02\x00\x00\x00\x00'
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d328290>
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F20487479%252Finterior_front_seats-1774706909547.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/20487479/interior_front_seats-1774706909547.jpeg saved to cache
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c300650>
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_rear_driver-1774706710292.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_driver-1774706710292.jpg saved to cache
2026-03-29 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28d290>
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Fexterior_rear_passenger-1774706727676.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_passenger-1774706727676.jpeg saved to cache
2026-03-29 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_driver-1774706683232.jpg> (referer: None)
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cada1d0>
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20107109%252Fexterior_front_driver-1774706683232.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_driver-1774706683232.jpg saved to cache
2026-03-29 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d
2026-03-29 20:16:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d, skipping ID generation
2026-03-29 20:16:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d with scrape type 1
2026-03-29 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d sending to next pipeline
2026-03-29 20:16:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d, identifier: 20107109
2026-03-29 20:16:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d with identifier: 20107109
2026-03-29 20:16:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d with identifier: 20107109
2026-03-29 20:16:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d with identifier: 20107109 to the API
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_driver-1774706683232.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK20 HUO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20107109',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 28000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1491893,
'Height': 2419,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_driver-1774706683232.jpg',
'Width': 3225},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672158,
'Height': 2689,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_driver-1774706710292.jpg',
'Width': 3585},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1611059,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_front_passenger-1774706727811.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1877738,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7109/20107109/exterior_rear_passenger-1774706713108.jpg',
'Width': 3563},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3306788,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7109/20107109/interior_front_seats-1774707307966.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3234466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7109/20107109/interior_rear_seats-1774707097133.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3227296,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7109/20107109/interior_dashboard-1774707120446.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2896567,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7109/20107109/instrument_cluster-1774707305581.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d/5d7dc7e2-2f2e-5567-9ded-6b688e3bd86d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3993265,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7109/20107109/interior_boot-1774707185123.jpg',
'Width': 4032}],
'price': 18028,
'price_includes_vat': False,
'registration_date': '2020-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque First ED D A',
'transmission': 'automatic',
'trim': 'Evoque First ED D A',
'vin': 'SALZA2AN0LH076682',
'year': 2020}
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720107109%27 HTTP/1.1" 200 None
2026-03-29 20:16:59 [motorway.uk] INFO: Saving data for 20107109: {'created_time': 1774815419.826986, 'last_price_update_time': 1774815419.826996, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20107109') HTTP/1.1" 204 0
2026-03-29 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7941/20487941/instrument_cluster-1774774574128.jpg> (referer: None)
2026-03-29 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_front_driver-1774706741703.jpeg> (referer: None)
2026-03-29 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_driver-1774706738834.jpeg> (referer: None)
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e925c50>
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Finstrument_cluster-1774774574128.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/instrument_cluster-1774774574128.jpg saved to cache
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e927490>
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Fexterior_front_driver-1774706741703.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_front_driver-1774706741703.jpeg saved to cache
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02c6d0>
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F20487479%252Fexterior_rear_driver-1774706738834.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_driver-1774706738834.jpeg saved to cache
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e66103fd-4730-5591-a0c2-6c4e4070f035
2026-03-29 20:17:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e66103fd-4730-5591-a0c2-6c4e4070f035 with identifier: 20487479
2026-03-29 20:17:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e66103fd-4730-5591-a0c2-6c4e4070f035 with identifier: 20487479
2026-03-29 20:17:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e66103fd-4730-5591-a0c2-6c4e4070f035 with identifier: 20487479 to the API
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e66103fd-4730-5591-a0c2-6c4e4070f035',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LJ65 BWX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487479',
'listing': 'auction',
'location': 'Greater London London',
'make': 'BMW',
'model': 'Z4',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_front_driver-1774706741703.jpeg',
'https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_driver-1774706738834.jpeg',
'https://motorway-photos-modified.imgix.net/7479/20487479/20487479-exterior_front_passenger-modified-1774709972085.jpeg',
'https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_passenger-1774706727676.jpeg',
'https://motorway-photos.imgix.net/7479/20487479/interior_front_seats-1774706909547.jpeg',
'https://motorway-photos-redacted.imgix.net/7479/20487479/interior_dashboard-1774706999720.jpeg',
'https://motorway-photos-redacted.imgix.net/7479/20487479/instrument_cluster-1774709767183.jpeg',
'https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg',
'https://motorway-service-history-photos.imgix.net/modified/7479/20487479/20487479-docs_service_history-modified-1774710555376.jpeg?ixlib=js-3.8.0&auto=format&s=46a9a4e6aeab20e2a3d8f2de44a81555',
'https://motorway-photos.imgix.net/7479/20487479/damage_scratches-1774707353640.jpeg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3964519,
'Height': 4510,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_front_driver-1774706741703.jpeg',
'Width': 6013},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5209975,
'Height': 5723,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_driver-1774706738834.jpeg',
'Width': 7630},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6338747,
'Height': 5709,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/20487479/exterior_rear_passenger-1774706727676.jpeg',
'Width': 7612},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 7957478,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/7479/20487479/interior_front_seats-1774706909547.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4828029,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/20487479/interior_dashboard-1774706999720.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8837544,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/20487479/instrument_cluster-1774709767183.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12738572,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/7479/20487479/interior_boot-1774709601319.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e66103fd-4730-5591-a0c2-6c4e4070f035/e66103fd-4730-5591-a0c2-6c4e4070f035_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 7015673,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/7479/20487479/damage_scratches-1774707353640.jpeg',
'Width': 8064}],
'price': 10993,
'price_includes_vat': False,
'registration_date': '2015-09-03',
'seats_number': None,
'seller_name': None,
'title': 'BMW Z4 SDRIVE28I M Sport Auto',
'transmission': 'automatic',
'trim': 'SDRIVE28I M Sport Auto',
'vin': 'WBALL52040P795184',
'year': 2015}
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487479%27 HTTP/1.1" 200 None
2026-03-29 20:17:00 [motorway.uk] INFO: Saving data for 20487479: {'created_time': 1774815420.872456, 'last_price_update_time': 1774815420.872467, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487479') HTTP/1.1" 204 0
2026-03-29 20:17:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item e66103fd-4730-5591-a0c2-6c4e4070f035 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7941/20487941/interior_dashboard-1774703736698.jpg> (referer: None)
2026-03-29 20:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_passenger-1774702473778.jpg> (referer: None)
2026-03-29 20:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7941/20487941/interior_front_seats-1774703620952.jpg> (referer: None)
2026-03-29 20:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7941/20487941/interior_rear_seats-1774703644897.jpg> (referer: None)
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8dc10>
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Finterior_dashboard-1774703736698.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/interior_dashboard-1774703736698.jpg saved to cache
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1e5d0>
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_rear_passenger-1774702473778.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_passenger-1774702473778.jpg saved to cache
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01ff90>
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7941%252F20487941%252Finterior_front_seats-1774703620952.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7941/20487941/interior_front_seats-1774703620952.jpg saved to cache
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cace5d0>
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7941%252F20487941%252Finterior_rear_seats-1774703644897.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7941/20487941/interior_rear_seats-1774703644897.jpg saved to cache
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_passenger-1774702486115.jpg> (referer: None)
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d29db90>
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_front_passenger-1774702486115.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_passenger-1774702486115.jpg saved to cache
2026-03-29 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_driver-1774702435157.jpg> (referer: None)
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9d79d0>
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_front_driver-1774702435157.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_driver-1774702435157.jpg saved to cache
2026-03-29 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_driver-1774702464081.jpg> (referer: None)
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa5710>
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7941%252F20487941%252Fexterior_rear_driver-1774702464081.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_driver-1774702464081.jpg saved to cache
2026-03-29 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c
2026-03-29 20:17:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d99dfe8d-c426-5e62-80f3-c54a89af7f3c, skipping ID generation
2026-03-29 20:17:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c with scrape type 1
2026-03-29 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d99dfe8d-c426-5e62-80f3-c54a89af7f3c sending to next pipeline
2026-03-29 20:17:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d99dfe8d-c426-5e62-80f3-c54a89af7f3c, identifier: 20487941
2026-03-29 20:17:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d99dfe8d-c426-5e62-80f3-c54a89af7f3c with identifier: 20487941
2026-03-29 20:17:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d99dfe8d-c426-5e62-80f3-c54a89af7f3c with identifier: 20487941
2026-03-29 20:17:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d99dfe8d-c426-5e62-80f3-c54a89af7f3c with identifier: 20487941 to the API
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_driver-1774702464081.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd99dfe8d-c426-5e62-80f3-c54a89af7f3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BX68 URE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487941',
'listing': 'auction',
'location': 'Hertfordshire Hitchin',
'make': 'Volvo',
'model': 'V90',
'odometer': 99023,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2138452,
'Height': 2900,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_driver-1774702435157.jpg',
'Width': 3866},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1865491,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_driver-1774702464081.jpg',
'Width': 3791},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1759775,
'Height': 2927,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_front_passenger-1774702486115.jpg',
'Width': 3903},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944635,
'Height': 2941,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7941/20487941/exterior_rear_passenger-1774702473778.jpg',
'Width': 3921},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4260496,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7941/20487941/interior_front_seats-1774703620952.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4404609,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7941/20487941/interior_rear_seats-1774703644897.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3351239,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7941/20487941/interior_dashboard-1774703736698.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1078940,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7941/20487941/instrument_cluster-1774774574128.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99dfe8d-c426-5e62-80f3-c54a89af7f3c/d99dfe8d-c426-5e62-80f3-c54a89af7f3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3489114,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7941/20487941/interior_boot-1774703743848.jpg',
'Width': 4032}],
'price': 12652,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Volvo V90 Cross Country PRO D4 AWD',
'transmission': 'automatic',
'trim': 'Cross Country PRO D4 AWD',
'vin': 'YV1PZA8BCJ1024929',
'year': 2018}
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487941%27 HTTP/1.1" 200 None
2026-03-29 20:17:02 [motorway.uk] INFO: Saving data for 20487941: {'created_time': 1774815422.891004, 'last_price_update_time': 1774815422.891017, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487941') HTTP/1.1" 204 0
2026-03-29 20:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3214/20303214/interior_boot-1774711572898.jpg> (referer: None)
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 518d050b-60b8-597e-b17b-2d9658a2f54d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d184a90>
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3214%252F20303214%252Finterior_boot-1774711572898.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3214/20303214/interior_boot-1774711572898.jpg saved to cache
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3214/20303214/instrument_cluster-1774711598185.jpg> (referer: None)
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacebd0>
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Finstrument_cluster-1774711598185.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/instrument_cluster-1774711598185.jpg saved to cache
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3214/20303214/interior_dashboard-1774711565209.jpg> (referer: None)
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa70d0>
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Finterior_dashboard-1774711565209.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/interior_dashboard-1774711565209.jpg saved to cache
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3214/20303214/interior_rear_seats-1774711863400.jpg> (referer: None)
2026-03-29 20:17:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadcd90>
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3214%252F20303214%252Finterior_rear_seats-1774711863400.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3214/20303214/interior_rear_seats-1774711863400.jpg saved to cache
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487634.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8725249.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce652a63-134c-582a-862a-cb586cc86f1f with identifier: 20487634
2026-03-29 20:17:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce652a63-134c-582a-862a-cb586cc86f1f with scrape type 1
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_front_driver-1774701463854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_driver-1774701463854.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_rear_driver-1774701560125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_driver-1774701560125.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_front_passenger-1774701505108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_passenger-1774701505108.jpg not downloaded yet
2026-03-29 20:17:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42a6a634-36f4-52a8-8072-7b24fd70e375 with identifier: 8725249
2026-03-29 20:17:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a6a634-36f4-52a8-8072-7b24fd70e375 with scrape type 1
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_front_driver-1774713545985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_driver-1774713545985.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_rear_passenger-1774701488326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_passenger-1774701488326.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_rear_driver-1774713568389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_driver-1774713568389.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7634%252F20487634%252Finterior_front_seats-1774701898591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7634/20487634/interior_front_seats-1774701898591.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_front_passenger-1774713592323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_passenger-1774713592323.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7634%252F20487634%252Finterior_rear_seats-1774701899765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7634/20487634/interior_rear_seats-1774701899765.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_rear_passenger-1774713579339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_passenger-1774713579339.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7634%252F20487634%252Finterior_dashboard-1774704194390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7634/20487634/interior_dashboard-1774704194390.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F8725249%252Finterior_front_seats-1774714016265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/8725249/interior_front_seats-1774714016265.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Finstrument_cluster-1774701937614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/instrument_cluster-1774701937614.jpg not downloaded yet
2026-03-29 20:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_driver-1774711086415.jpg> (referer: None)
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F8725249%252Finterior_rear_seats-1774714041111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/8725249/interior_rear_seats-1774714041111.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7634%252F20487634%252Finterior_boot-1774701896163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7634/20487634/interior_boot-1774701896163.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Finterior_dashboard-1774714119289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/interior_dashboard-1774714119289.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fwheels_front_driver-1774701603111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/wheels_front_driver-1774701603111.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Finstrument_cluster-1774714120266.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/instrument_cluster-1774714120266.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F8725249%252Finterior_boot-1774714088089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/8725249/interior_boot-1774714088089.jpg not downloaded yet
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5249%252F8725249%252Fdocs_service_history-1774714207356.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D337febd55cfc8467b7fd0af8bfe85fa8%27 HTTP/1.1" 200 None
2026-03-29 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5249/8725249/docs_service_history-1774714207356.jpg?ixlib=js-3.8.0&auto=format&s=337febd55cfc8467b7fd0af8bfe85fa8 not downloaded yet
2026-03-29 20:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_passenger-1774543633993.jpg> (referer: None)
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16f010>
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_rear_driver-1774711086415.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_driver-1774711086415.jpg saved to cache
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=324&page=9&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16e710>
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_front_passenger-1774543633993.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_passenger-1774543633993.jpg saved to cache
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328
2026-03-29 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_front_driver-1774711020468.jpg> (referer: None)
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20418717
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20488067
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20395274
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20486896
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20440824
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20375069
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20346137
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 18144090
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20494274
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 17611268
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20483899
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483899%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20483899: 1
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20483826
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20469913
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469913%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20469913: 1
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20459015
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459015%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20459015: 2
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20471501
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471501%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20471501: 1
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 16772824
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20121550
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 17470157
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 19824525
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20370017
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720370017%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20370017: 1
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20382041
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382041%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20382041: 1
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20428604
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20185351
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720185351%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 20185351: 1
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e064650>
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3214%252F20303214%252Fexterior_front_driver-1774711020468.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_front_driver-1774711020468.jpg saved to cache
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 518d050b-60b8-597e-b17b-2d9658a2f54d
2026-03-29 20:17:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 518d050b-60b8-597e-b17b-2d9658a2f54d, skipping ID generation
2026-03-29 20:17:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518d050b-60b8-597e-b17b-2d9658a2f54d with scrape type 1
2026-03-29 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 518d050b-60b8-597e-b17b-2d9658a2f54d sending to next pipeline
2026-03-29 20:17:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 518d050b-60b8-597e-b17b-2d9658a2f54d, identifier: 20303214
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 14545909
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 20188633
2026-03-29 20:17:05 [motorway.uk] INFO: Found listing with ID: 17103119
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717103119%27 HTTP/1.1" 200 None
2026-03-29 20:17:05 [motorway.uk] INFO: Scrape type for 17103119: 1
2026-03-29 20:17:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 518d050b-60b8-597e-b17b-2d9658a2f54d with identifier: 20303214
2026-03-29 20:17:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 518d050b-60b8-597e-b17b-2d9658a2f54d with identifier: 20303214
2026-03-29 20:17:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 518d050b-60b8-597e-b17b-2d9658a2f54d with identifier: 20303214 to the API
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_front_driver-1774711020468.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '518d050b-60b8-597e-b17b-2d9658a2f54d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'Y23 LMP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20303214',
'listing': 'auction',
'location': 'Surrey Walton-on-Thames',
'make': 'Ford',
'model': 'Ecosport',
'odometer': 18665,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2090455,
'Height': 2858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_front_driver-1774711020468.jpg',
'Width': 3810},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1984402,
'Height': 2840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_driver-1774711086415.jpg',
'Width': 3787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203900,
'Height': 2885,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3214/20303214/exterior_rear_passenger-1774711046486.jpg',
'Width': 3847},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4250347,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3214/20303214/interior_front_seats-1774711520980.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4437614,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3214/20303214/interior_rear_seats-1774711863400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3284149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3214/20303214/interior_dashboard-1774711565209.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2518994,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3214/20303214/instrument_cluster-1774711598185.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_518d050b-60b8-597e-b17b-2d9658a2f54d/518d050b-60b8-597e-b17b-2d9658a2f54d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4108278,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3214/20303214/interior_boot-1774711572898.jpg',
'Width': 4032}],
'price': 8384,
'price_includes_vat': False,
'registration_date': '2020-07-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ecosport Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'vin': 'WF01XXERK1KU87914',
'year': 2020}
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303214%27 HTTP/1.1" 200 None
2026-03-29 20:17:06 [motorway.uk] INFO: Saving data for 20303214: {'created_time': 1774815426.114677, 'last_price_update_time': 1774815426.114696, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20303214') HTTP/1.1" 204 0
2026-03-29 20:17:06 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 31 pages/min), scraped 47 items (at 25 items/min)
2026-03-29 20:17:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 242MiB
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 19976195
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 20476001
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476001%27 HTTP/1.1" 200 None
2026-03-29 20:17:06 [motorway.uk] INFO: Scrape type for 20476001: 1
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 20489379
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 14248545
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 20489087
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 9706336
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279706336%27 HTTP/1.1" 200 None
2026-03-29 20:17:06 [motorway.uk] INFO: Scrape type for 9706336: 1
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 20235497
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235497%27 HTTP/1.1" 200 None
2026-03-29 20:17:06 [motorway.uk] INFO: Scrape type for 20235497: 1
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 19465246
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719465246%27 HTTP/1.1" 200 None
2026-03-29 20:17:06 [motorway.uk] INFO: Scrape type for 19465246: 1
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 20474206
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474206%27 HTTP/1.1" 200 None
2026-03-29 20:17:06 [motorway.uk] INFO: Scrape type for 20474206: 1
2026-03-29 20:17:06 [motorway.uk] INFO: Found listing with ID: 17699246
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 42a6a634-36f4-52a8-8072-7b24fd70e375 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5249/8725249/interior_front_seats-1774714016265.jpg> (referer: None)
2026-03-29 20:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5249/8725249/instrument_cluster-1774714120266.jpg> (referer: None)
2026-03-29 20:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5249/8725249/interior_boot-1774714088089.jpg> (referer: None)
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad4310>
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F8725249%252Finterior_front_seats-1774714016265.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/8725249/interior_front_seats-1774714016265.jpg saved to cache
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc4ad0>
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Finstrument_cluster-1774714120266.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/instrument_cluster-1774714120266.jpg saved to cache
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21f910>
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F8725249%252Finterior_boot-1774714088089.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/8725249/interior_boot-1774714088089.jpg saved to cache
2026-03-29 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20453358.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d796e21e-43d0-54c7-ab17-ffe066188415 with identifier: 20453358
2026-03-29 20:17:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d796e21e-43d0-54c7-ab17-ffe066188415 with scrape type 1
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Fexterior_front_driver-1774624150872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_driver-1774624150872.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3358%252F20453358%252Fexterior_rear_driver-1774690431592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3358/20453358/exterior_rear_driver-1774690431592.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Fexterior_front_passenger-1774624204175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_passenger-1774624204175.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Fexterior_rear_passenger-1774624238274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_rear_passenger-1774624238274.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20453358%252Finterior_front_seats-1774624680312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20453358/interior_front_seats-1774624680312.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20453358%252Finterior_rear_seats-1774624700574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20453358/interior_rear_seats-1774624700574.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Finterior_dashboard-1774624603775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/interior_dashboard-1774624603775.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3358%252F20453358%252Finstrument_cluster-1774690449501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3358/20453358/instrument_cluster-1774690449501.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20453358%252Finterior_boot-1774624529081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20453358/interior_boot-1774624529081.jpg not downloaded yet
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3358%252F20453358%252Fdocs_service_history-1774624783460.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcaf15fbc107263c4a0498226c291e15a%27 HTTP/1.1" 200 None
2026-03-29 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3358/20453358/docs_service_history-1774624783460.jpg?ixlib=js-3.8.0&auto=format&s=caf15fbc107263c4a0498226c291e15a not downloaded yet
2026-03-29 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18874288.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfc2a4f4-73b8-5214-975a-559d01cc8080 with identifier: 18874288
2026-03-29 20:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc2a4f4-73b8-5214-975a-559d01cc8080 with scrape type 1
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfc2a4f4-73b8-5214-975a-559d01cc8080
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F18874288%252Fexterior_front_driver-1774105135714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_front_driver-1774105135714.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F18874288%252Fexterior_rear_driver-1774105149190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_rear_driver-1774105149190.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F18874288%252Fexterior_front_passenger-1774105145476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_front_passenger-1774105145476.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F18874288%252Fexterior_rear_passenger-1774105072456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_rear_passenger-1774105072456.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4288%252F18874288%252Finterior_front_seats-1774105600874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4288/18874288/interior_front_seats-1774105600874.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4288%252F18874288%252Finterior_rear_seats-1774105630094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4288/18874288/interior_rear_seats-1774105630094.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4288%252F18874288%252Finterior_dashboard-1774109254144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4288/18874288/interior_dashboard-1774109254144.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4288%252F18874288%252Finstrument_cluster-1774109240615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4288/18874288/instrument_cluster-1774109240615.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4288%252F18874288%252Finterior_boot-1774105698057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4288/18874288/interior_boot-1774105698057.jpg already downloaded
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4288%252F18874288%252Fdocs_service_history-1774108229408.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8ede6ea39a6e8daf54cb425906a849c0%27 HTTP/1.1" 200 None
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4288/18874288/docs_service_history-1774108229408.jpg?ixlib=js-3.8.0&auto=format&s=8ede6ea39a6e8daf54cb425906a849c0 already downloaded
2026-03-29 20:17:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cfc2a4f4-73b8-5214-975a-559d01cc8080, identifier: 18874288
2026-03-29 20:17:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cfc2a4f4-73b8-5214-975a-559d01cc8080 with identifier: 18874288
2026-03-29 20:17:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cfc2a4f4-73b8-5214-975a-559d01cc8080 with identifier: 18874288
2026-03-29 20:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cfc2a4f4-73b8-5214-975a-559d01cc8080 with identifier: 18874288 to the API
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18874288.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cfc2a4f4-73b8-5214-975a-559d01cc8080',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MT70 THZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18874288',
'listing': 'auction',
'location': 'Gloucestershire Gloucester',
'make': 'BMW',
'model': '8 Series',
'odometer': 21950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_front_driver-1774105135714.jpg',
'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_rear_driver-1774105149190.jpg',
'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_front_passenger-1774105145476.jpg',
'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_rear_passenger-1774105072456.jpg',
'https://motorway-photos.imgix.net/4288/18874288/interior_front_seats-1774105600874.jpg',
'https://motorway-photos.imgix.net/4288/18874288/interior_rear_seats-1774105630094.jpg',
'https://motorway-photos-modified.imgix.net/4288/18874288/interior_dashboard-1774109254144.jpg',
'https://motorway-photos-modified.imgix.net/4288/18874288/instrument_cluster-1774109240615.jpg',
'https://motorway-photos.imgix.net/4288/18874288/interior_boot-1774105698057.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/4288/18874288/docs_service_history-1774108229408.jpg?ixlib=js-3.8.0&auto=format&s=8ede6ea39a6e8daf54cb425906a849c0'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1499196,
'Height': 2294,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_front_driver-1774105135714.jpg',
'Width': 3058},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2157562,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_rear_driver-1774105149190.jpg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424524,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_front_passenger-1774105145476.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538756,
'Height': 2316,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/18874288/exterior_rear_passenger-1774105072456.jpg',
'Width': 3088},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3541991,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4288/18874288/interior_front_seats-1774105600874.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3644289,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4288/18874288/interior_rear_seats-1774105630094.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2249126,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4288/18874288/interior_dashboard-1774109254144.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473716,
'Height': 1653,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4288/18874288/instrument_cluster-1774109240615.jpg',
'Width': 2204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2974651,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4288/18874288/interior_boot-1774105698057.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9/df073e36-4e73-56d7-9dc1-2f0bdaf5fcf9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3082714,
'Height': 1778,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4288/18874288/docs_service_history-1774108229408.jpg?ixlib=js-3.8.0&auto=format&s=8ede6ea39a6e8daf54cb425906a849c0',
'Width': 2427}],
'price': 28628,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 840I Auto',
'transmission': 'automatic',
'trim': '840I Auto',
'vin': 'WBAAE22070CF13579',
'year': 2020}
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718874288%27 HTTP/1.1" 200 None
2026-03-29 20:17:13 [motorway.uk] INFO: Saving data for 18874288: {'created_time': 1774815433.099982, 'last_price_update_time': 1774815433.099994, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18874288') HTTP/1.1" 204 0
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item d796e21e-43d0-54c7-ab17-ffe066188415 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19785042.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fae474eb-6331-5c09-8381-8f544aefd4b3 with identifier: 19785042
2026-03-29 20:17:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fae474eb-6331-5c09-8381-8f544aefd4b3 with scrape type 1
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5042%252F19785042%252Fexterior_front_driver-1774775058131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5042/19785042/exterior_front_driver-1774775058131.jpg not downloaded yet
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Fexterior_rear_driver-1774030248481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_driver-1774030248481.jpg not downloaded yet
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Fexterior_front_passenger-1774030213647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_front_passenger-1774030213647.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Fexterior_rear_passenger-1774030204320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_passenger-1774030204320.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5042%252F19785042%252Finterior_front_seats-1774030703102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5042/19785042/interior_front_seats-1774030703102.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5042%252F19785042%252Finterior_rear_seats-1774030661191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5042/19785042/interior_rear_seats-1774030661191.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Finterior_dashboard-1774030678331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/interior_dashboard-1774030678331.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Finstrument_cluster-1774030727062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/instrument_cluster-1774030727062.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5042%252F19785042%252Finterior_boot-1774030657851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5042/19785042/interior_boot-1774030657851.jpg not downloaded yet
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5042%252F19785042%252Fdocs_service_history-1774030784805.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D08920d515f51f94b8c11f1844225f825%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5042/19785042/docs_service_history-1774030784805.jpg?ixlib=js-3.8.0&auto=format&s=08920d515f51f94b8c11f1844225f825 not downloaded yet
2026-03-29 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3358/20453358/interior_boot-1774624529081.jpg> (referer: None)
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cab1950>
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20453358%252Finterior_boot-1774624529081.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20453358/interior_boot-1774624529081.jpg saved to cache
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item d796e21e-43d0-54c7-ab17-ffe066188415 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5042/19785042/interior_boot-1774030657851.jpg> (referer: None)
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce72450>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5042%252F19785042%252Finterior_boot-1774030657851.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5042/19785042/interior_boot-1774030657851.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5042/19785042/instrument_cluster-1774030727062.jpg> (referer: None)
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5042/19785042/interior_rear_seats-1774030661191.jpg> (referer: None)
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca72010>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Finstrument_cluster-1774030727062.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/instrument_cluster-1774030727062.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5042/19785042/interior_front_seats-1774030703102.jpg> (referer: None)
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item fae474eb-6331-5c09-8381-8f544aefd4b3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c231590>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5042%252F19785042%252Finterior_rear_seats-1774030661191.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5042/19785042/interior_rear_seats-1774030661191.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5042/19785042/interior_dashboard-1774030678331.jpg> (referer: None)
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce73f50>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5042%252F19785042%252Finterior_front_seats-1774030703102.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5042/19785042/interior_front_seats-1774030703102.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5052d0>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Finterior_dashboard-1774030678331.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/interior_dashboard-1774030678331.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_passenger-1774030204320.jpg> (referer: None)
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_front_passenger-1774030213647.jpg> (referer: None)
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc6510>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Fexterior_rear_passenger-1774030204320.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_passenger-1774030204320.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec05290>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Fexterior_front_passenger-1774030213647.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_front_passenger-1774030213647.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_driver-1774030248481.jpg> (referer: None)
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d030110>
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5042%252F19785042%252Fexterior_rear_driver-1774030248481.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_driver-1774030248481.jpg saved to cache
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fae474eb-6331-5c09-8381-8f544aefd4b3
2026-03-29 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20453358/interior_dashboard-1774624603775.jpg> (referer: None)
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d504650>
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Finterior_dashboard-1774624603775.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/interior_dashboard-1774624603775.jpg saved to cache
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3358/20453358/interior_rear_seats-1774624700574.jpg> (referer: None)
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec07690>
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20453358%252Finterior_rear_seats-1774624700574.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20453358/interior_rear_seats-1774624700574.jpg saved to cache
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20462094.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3358/20453358/interior_front_seats-1774624680312.jpg> (referer: None)
2026-03-29 20:17:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fae474eb-6331-5c09-8381-8f544aefd4b3 with identifier: 19785042
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Green HTTP/1.1" 200 None
2026-03-29 20:17:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:17:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fae474eb-6331-5c09-8381-8f544aefd4b3 with identifier: 19785042
2026-03-29 20:17:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fae474eb-6331-5c09-8381-8f544aefd4b3 with identifier: 19785042 to the API
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'fae474eb-6331-5c09-8381-8f544aefd4b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK23 OLG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19785042',
'listing': 'auction',
'location': 'Worcestershire Worcester',
'make': 'Hyundai',
'model': 'I20',
'odometer': 27601,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-modified.imgix.net/5042/19785042/exterior_front_driver-1774775058131.jpg',
'https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_driver-1774030248481.jpg',
'https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_front_passenger-1774030213647.jpg',
'https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_passenger-1774030204320.jpg',
'https://motorway-photos.imgix.net/5042/19785042/interior_front_seats-1774030703102.jpg',
'https://motorway-photos.imgix.net/5042/19785042/interior_rear_seats-1774030661191.jpg',
'https://motorway-photos-redacted.imgix.net/5042/19785042/interior_dashboard-1774030678331.jpg',
'https://motorway-photos-redacted.imgix.net/5042/19785042/instrument_cluster-1774030727062.jpg',
'https://motorway-photos.imgix.net/5042/19785042/interior_boot-1774030657851.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5042/19785042/docs_service_history-1774030784805.jpg?ixlib=js-3.8.0&auto=format&s=08920d515f51f94b8c11f1844225f825'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95905,
'Height': 624,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_driver-1774030248481.jpg',
'Width': 832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109049,
'Height': 643,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_front_passenger-1774030213647.jpg',
'Width': 857},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103445,
'Height': 602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5042/19785042/exterior_rear_passenger-1774030204320.jpg',
'Width': 802},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107929,
'Height': 768,
'OriginUrl': 'https://motorway-photos.imgix.net/5042/19785042/interior_front_seats-1774030703102.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99019,
'Height': 768,
'OriginUrl': 'https://motorway-photos.imgix.net/5042/19785042/interior_rear_seats-1774030661191.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103735,
'Height': 768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5042/19785042/interior_dashboard-1774030678331.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132211,
'Height': 768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5042/19785042/instrument_cluster-1774030727062.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fae474eb-6331-5c09-8381-8f544aefd4b3/fae474eb-6331-5c09-8381-8f544aefd4b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173091,
'Height': 768,
'OriginUrl': 'https://motorway-photos.imgix.net/5042/19785042/interior_boot-1774030657851.jpg',
'Width': 1024}],
'price': 10990,
'price_includes_vat': False,
'registration_date': '2023-03-27',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I20 SE Connect MHEV T-GDi',
'transmission': 'manual',
'trim': 'SE Connect MHEV T-GDi',
'vin': 'NLHBN51GLPZ292461',
'year': 2023}
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719785042%27 HTTP/1.1" 200 None
2026-03-29 20:17:19 [motorway.uk] INFO: Saving data for 19785042: {'created_time': 1774815439.711289, 'last_price_update_time': 1774815439.7113, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19785042') HTTP/1.1" 204 0
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item fae474eb-6331-5c09-8381-8f544aefd4b3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e3d373-0fb1-52aa-b519-d68e9dd29d97 with identifier: 20462094
2026-03-29 20:17:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97 with scrape type 1
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_front_driver-1774610158220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_driver-1774610158220.jpg not downloaded yet
2026-03-29 20:17:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caf9ad0>
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3358%252F20453358%252Finterior_front_seats-1774624680312.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3358/20453358/interior_front_seats-1774624680312.jpg saved to cache
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_rear_driver-1774610172720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_driver-1774610172720.jpg not downloaded yet
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_front_passenger-1774610203030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_passenger-1774610203030.jpg not downloaded yet
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_rear_passenger-1774610188921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_passenger-1774610188921.jpg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Finterior_front_seats-1774610437651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/interior_front_seats-1774610437651.jpg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Finterior_rear_seats-1774610468766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/interior_rear_seats-1774610468766.jpg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2094%252F20462094%252Finterior_dashboard-1774613510220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2094/20462094/interior_dashboard-1774613510220.jpg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Finstrument_cluster-1774610547327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/instrument_cluster-1774610547327.jpg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Finterior_boot-1774610512042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/interior_boot-1774610512042.jpg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Fdamage_windscreen-1774610254749.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/damage_windscreen-1774610254749.jpg not downloaded yet
2026-03-29 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_passenger-1774624204175.jpg> (referer: None)
2026-03-29 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_rear_passenger-1774624238274.jpg> (referer: None)
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae4fd0>
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Fexterior_front_passenger-1774624204175.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_passenger-1774624204175.jpg saved to cache
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb00150>
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Fexterior_rear_passenger-1774624238274.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_rear_passenger-1774624238274.jpg saved to cache
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2094/20462094/interior_boot-1774610512042.jpg> (referer: None)
2026-03-29 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2094/20462094/damage_windscreen-1774610254749.jpg> (referer: None)
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b7a50>
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Finterior_boot-1774610512042.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/interior_boot-1774610512042.jpg saved to cache
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea65090>
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Fdamage_windscreen-1774610254749.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/damage_windscreen-1774610254749.jpg saved to cache
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item d796e21e-43d0-54c7-ab17-ffe066188415 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2094/20462094/instrument_cluster-1774610547327.jpg> (referer: None)
2026-03-29 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2094/20462094/interior_rear_seats-1774610468766.jpg> (referer: None)
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb94990>
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Finstrument_cluster-1774610547327.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/instrument_cluster-1774610547327.jpg saved to cache
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c214fd0>
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Finterior_rear_seats-1774610468766.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/interior_rear_seats-1774610468766.jpg saved to cache
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_passenger-1774610188921.jpg> (referer: None)
2026-03-29 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2094/20462094/interior_front_seats-1774610437651.jpg> (referer: None)
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c245990>
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_rear_passenger-1774610188921.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_passenger-1774610188921.jpg saved to cache
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad1990>
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2094%252F20462094%252Finterior_front_seats-1774610437651.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2094/20462094/interior_front_seats-1774610437651.jpg saved to cache
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_passenger-1774610203030.jpg> (referer: None)
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1e10>
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_front_passenger-1774610203030.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_passenger-1774610203030.jpg saved to cache
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_driver-1774610172720.jpg> (referer: None)
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad1290>
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_rear_driver-1774610172720.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_driver-1774610172720.jpg saved to cache
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_driver-1774610158220.jpg> (referer: None)
2026-03-29 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_driver-1774624150872.jpg> (referer: None)
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c244b90>
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2094%252F20462094%252Fexterior_front_driver-1774610158220.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_driver-1774610158220.jpg saved to cache
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97
2026-03-29 20:17:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3e3d373-0fb1-52aa-b519-d68e9dd29d97, skipping ID generation
2026-03-29 20:17:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97 with scrape type 1
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3e3d373-0fb1-52aa-b519-d68e9dd29d97 sending to next pipeline
2026-03-29 20:17:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c3e3d373-0fb1-52aa-b519-d68e9dd29d97, identifier: 20462094
2026-03-29 20:17:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c3e3d373-0fb1-52aa-b519-d68e9dd29d97 with identifier: 20462094
2026-03-29 20:17:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c3e3d373-0fb1-52aa-b519-d68e9dd29d97 with identifier: 20462094
2026-03-29 20:17:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c3e3d373-0fb1-52aa-b519-d68e9dd29d97 with identifier: 20462094 to the API
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_driver-1774610158220.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c3e3d373-0fb1-52aa-b519-d68e9dd29d97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'R123 EEF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20462094',
'listing': 'auction',
'location': 'Dorset Dorchester',
'make': 'Audi',
'model': 'S4',
'odometer': 50150,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848896,
'Height': 2443,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_driver-1774610158220.jpg',
'Width': 3257},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1324336,
'Height': 2200,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_driver-1774610172720.jpg',
'Width': 2933},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1531075,
'Height': 2459,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_front_passenger-1774610203030.jpg',
'Width': 3278},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1809354,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2094/20462094/exterior_rear_passenger-1774610188921.jpg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3540693,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2094/20462094/interior_front_seats-1774610437651.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2748882,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2094/20462094/interior_rear_seats-1774610468766.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1324561,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2094/20462094/instrument_cluster-1774610547327.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4097069,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2094/20462094/interior_boot-1774610512042.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e3d373-0fb1-52aa-b519-d68e9dd29d97/c3e3d373-0fb1-52aa-b519-d68e9dd29d97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2619695,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2094/20462094/damage_windscreen-1774610254749.jpg',
'Width': 4032}],
'price': 27605,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi S4 Black Edition TDI Quattro A',
'transmission': 'automatic',
'trim': 'Black Edition TDI Quattro A',
'vin': 'WAUZZZF49LA069230',
'year': 2021}
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462094%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Saving data for 20462094: {'created_time': 1774815443.145024, 'last_price_update_time': 1774815443.145034, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20462094') HTTP/1.1" 204 0
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd2a10>
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3358%252F20453358%252Fexterior_front_driver-1774624150872.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_driver-1774624150872.jpg saved to cache
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d796e21e-43d0-54c7-ab17-ffe066188415
2026-03-29 20:17:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d796e21e-43d0-54c7-ab17-ffe066188415, skipping ID generation
2026-03-29 20:17:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d796e21e-43d0-54c7-ab17-ffe066188415 with scrape type 1
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d796e21e-43d0-54c7-ab17-ffe066188415 sending to next pipeline
2026-03-29 20:17:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d796e21e-43d0-54c7-ab17-ffe066188415, identifier: 20453358
2026-03-29 20:17:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d796e21e-43d0-54c7-ab17-ffe066188415 with identifier: 20453358
2026-03-29 20:17:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d796e21e-43d0-54c7-ab17-ffe066188415 with identifier: 20453358
2026-03-29 20:17:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d796e21e-43d0-54c7-ab17-ffe066188415 with identifier: 20453358 to the API
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_driver-1774624150872.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'd796e21e-43d0-54c7-ab17-ffe066188415',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU71 RZT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20453358',
'listing': 'auction',
'location': 'West Sussex Brighton',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 24000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2372166,
'Height': 2986,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_driver-1774624150872.jpg',
'Width': 3981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1981751,
'Height': 3008,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_front_passenger-1774624204175.jpg',
'Width': 4010},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2086188,
'Height': 2794,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20453358/exterior_rear_passenger-1774624238274.jpg',
'Width': 3725},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3073436,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3358/20453358/interior_front_seats-1774624680312.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2308564,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3358/20453358/interior_rear_seats-1774624700574.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1584622,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3358/20453358/interior_dashboard-1774624603775.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d796e21e-43d0-54c7-ab17-ffe066188415/d796e21e-43d0-54c7-ab17-ffe066188415_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2713270,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3358/20453358/interior_boot-1774624529081.jpg',
'Width': 4032}],
'price': 7595,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa E Elite NAV Premium',
'transmission': 'automatic',
'trim': 'E Elite NAV Premium',
'vin': 'VXKUHZKXZM4289593',
'year': 2021}
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453358%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Saving data for 20453358: {'created_time': 1774815443.718099, 'last_price_update_time': 1774815443.718111, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20453358') HTTP/1.1" 204 0
2026-03-29 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487406.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac6871dd-eca1-51f4-b783-8c166b764a2c with identifier: 20487406
2026-03-29 20:17:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac6871dd-eca1-51f4-b783-8c166b764a2c with scrape type 1
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_front_driver-1774702958517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_driver-1774702958517.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_rear_driver-1774702864102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_driver-1774702864102.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_front_passenger-1774702850084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_passenger-1774702850084.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_rear_passenger-1774702732212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_passenger-1774702732212.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7406%252F20487406%252Finterior_front_seats-1774703363407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7406/20487406/interior_front_seats-1774703363407.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7406%252F20487406%252Finterior_rear_seats-1774703376925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7406/20487406/interior_rear_seats-1774703376925.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Finterior_dashboard-1774703407649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/interior_dashboard-1774703407649.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Finstrument_cluster-1774703468640.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/instrument_cluster-1774703468640.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7406%252F20487406%252Finterior_boot-1774703417497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7406/20487406/interior_boot-1774703417497.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7406%252F20487406%252Fdocs_service_history-1774703707336.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ce90fdc34e78aafe341412585ddc989%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7406/20487406/docs_service_history-1774703707336.jpg?ixlib=js-3.8.0&auto=format&s=3ce90fdc34e78aafe341412585ddc989 not downloaded yet
2026-03-29 20:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20130616.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 with identifier: 20130616
2026-03-29 20:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 with scrape type 1
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_front_driver-1774700542534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_driver-1774700542534.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_rear_driver-1774700558071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_driver-1774700558071.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_front_passenger-1774700584390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_passenger-1774700584390.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_rear_passenger-1774700570390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_passenger-1774700570390.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Finterior_front_seats-1774701032089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/interior_front_seats-1774701032089.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Finterior_rear_seats-1774701040730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/interior_rear_seats-1774701040730.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Finterior_dashboard-1774701171464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/interior_dashboard-1774701171464.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Finstrument_cluster-1774701139149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/instrument_cluster-1774701139149.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Finterior_boot-1774701099446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/interior_boot-1774701099446.jpg not downloaded yet
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Fdamage_scratches-1774700679887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/damage_scratches-1774700679887.jpg not downloaded yet
2026-03-29 20:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19164973.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf0cae7f-eae2-5f61-991b-51b780a10b08 with identifier: 19164973
2026-03-29 20:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf0cae7f-eae2-5f61-991b-51b780a10b08 with scrape type 1
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf0cae7f-eae2-5f61-991b-51b780a10b08
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4973%252F19164973%252F19164973-exterior_front_driver-modified-1774273864628.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4973/19164973/19164973-exterior_front_driver-modified-1774273864628.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4973%252F19164973%252Fexterior_rear_driver-1767790288081.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4973/19164973/exterior_rear_driver-1767790288081.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4973%252F19164973%252F19164973-exterior_front_passenger-modified-1774273876154.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4973/19164973/19164973-exterior_front_passenger-modified-1774273876154.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4973%252F19164973%252Fexterior_rear_passenger-1767790279809.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4973/19164973/exterior_rear_passenger-1767790279809.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4973%252F19164973%252Finterior_front_seats-1767790354194.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4973/19164973/interior_front_seats-1767790354194.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4973%252F19164973%252Finterior_rear_seats-1767790425683.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4973/19164973/interior_rear_seats-1767790425683.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4973%252F19164973%252F19164973-interior_dashboard-modified-1774273893466.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4973/19164973/19164973-interior_dashboard-modified-1774273893466.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4973%252F19164973%252Finstrument_cluster-1767790397661.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4973/19164973/instrument_cluster-1767790397661.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4973%252F19164973%252Finterior_boot-1767790450852.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4973/19164973/interior_boot-1767790450852.jpeg already downloaded
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4973%252F19164973%252F19164973-docs_service_history-modified-1768467367235.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6553020300a8f9abab7f27dd127082da%27 HTTP/1.1" 200 None
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4973/19164973/19164973-docs_service_history-modified-1768467367235.jpeg?ixlib=js-3.8.0&auto=format&s=6553020300a8f9abab7f27dd127082da already downloaded
2026-03-29 20:17:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cf0cae7f-eae2-5f61-991b-51b780a10b08, identifier: 19164973
2026-03-29 20:17:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cf0cae7f-eae2-5f61-991b-51b780a10b08 with identifier: 19164973
2026-03-29 20:17:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cf0cae7f-eae2-5f61-991b-51b780a10b08 with identifier: 19164973
2026-03-29 20:17:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cf0cae7f-eae2-5f61-991b-51b780a10b08 with identifier: 19164973 to the API
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19164973.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'cf0cae7f-eae2-5f61-991b-51b780a10b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO21 KCG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19164973',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 47983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://motorway-photos-modified.imgix.net/4973/19164973/19164973-exterior_front_driver-modified-1774273864628.jpeg',
'https://motorway-photos-redacted.imgix.net/4973/19164973/exterior_rear_driver-1767790288081.jpeg',
'https://motorway-photos-modified.imgix.net/4973/19164973/19164973-exterior_front_passenger-modified-1774273876154.jpeg',
'https://motorway-photos-redacted.imgix.net/4973/19164973/exterior_rear_passenger-1767790279809.jpeg',
'https://motorway-photos.imgix.net/4973/19164973/interior_front_seats-1767790354194.jpeg',
'https://motorway-photos.imgix.net/4973/19164973/interior_rear_seats-1767790425683.jpeg',
'https://motorway-photos-modified.imgix.net/4973/19164973/19164973-interior_dashboard-modified-1774273893466.jpeg',
'https://motorway-photos.imgix.net/4973/19164973/instrument_cluster-1767790397661.jpeg',
'https://motorway-photos.imgix.net/4973/19164973/interior_boot-1767790450852.jpeg',
'https://motorway-service-history-photos.imgix.net/modified/4973/19164973/19164973-docs_service_history-modified-1768467367235.jpeg?ixlib=js-3.8.0&auto=format&s=6553020300a8f9abab7f27dd127082da'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1595700,
'Height': 2099,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4973/19164973/19164973-exterior_front_driver-modified-1774273864628.jpeg',
'Width': 2799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1637176,
'Height': 2319,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4973/19164973/exterior_rear_driver-1767790288081.jpeg',
'Width': 3092},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2485388,
'Height': 2778,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4973/19164973/19164973-exterior_front_passenger-modified-1774273876154.jpeg',
'Width': 3704},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1524374,
'Height': 2486,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4973/19164973/exterior_rear_passenger-1767790279809.jpeg',
'Width': 3315},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3887125,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4973/19164973/interior_front_seats-1767790354194.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4151049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4973/19164973/interior_rear_seats-1767790425683.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2231565,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4973/19164973/19164973-interior_dashboard-modified-1774273893466.jpeg',
'Width': 3703},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2801136,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4973/19164973/instrument_cluster-1767790397661.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4562382,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4973/19164973/interior_boot-1767790450852.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf0cae7f-eae2-5f61-991b-51b780a10b08/cf0cae7f-eae2-5f61-991b-51b780a10b08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2034194,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4973/19164973/19164973-docs_service_history-modified-1768467367235.jpeg?ixlib=js-3.8.0&auto=format&s=6553020300a8f9abab7f27dd127082da',
'Width': 3024}],
'price': 15242,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R-LINE Etsi S-A',
'transmission': 'automatic',
'trim': 'R-LINE Etsi S-A',
'vin': 'WVWZZZCDZMW341211',
'year': 2021}
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719164973%27 HTTP/1.1" 200 None
2026-03-29 20:17:27 [motorway.uk] INFO: Saving data for 19164973: {'created_time': 1774815447.421281, 'last_price_update_time': 1774815447.421291, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19164973') HTTP/1.1" 204 0
2026-03-29 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0616/20130616/damage_scratches-1774700679887.jpg> (referer: None)
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item ac6871dd-eca1-51f4-b783-8c166b764a2c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca727d0>
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Fdamage_scratches-1774700679887.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/damage_scratches-1774700679887.jpg saved to cache
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=360&page=10&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0616/20130616/interior_boot-1774701099446.jpg> (referer: None)
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 18969142
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 19163712
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 10452717
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710452717%27 HTTP/1.1" 200 None
2026-03-29 20:17:27 [motorway.uk] INFO: Scrape type for 10452717: 1
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 18171472
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20302141
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20404971
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 19535149
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20368231
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 19585852
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719585852%27 HTTP/1.1" 200 None
2026-03-29 20:17:27 [motorway.uk] INFO: Scrape type for 19585852: 1
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20303922
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 19960180
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 17662839
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20459994
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 19144130
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20459047
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 18354443
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 20148114
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 12711502
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 19337875
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 10813763
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 18907003
2026-03-29 20:17:27 [motorway.uk] INFO: Found listing with ID: 15916141
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715916141%27 HTTP/1.1" 200 None
2026-03-29 20:17:28 [motorway.uk] INFO: Scrape type for 15916141: 1
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20257823
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720257823%27 HTTP/1.1" 200 None
2026-03-29 20:17:28 [motorway.uk] INFO: Scrape type for 20257823: 1
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20475074
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475074%27 HTTP/1.1" 200 None
2026-03-29 20:17:28 [motorway.uk] INFO: Scrape type for 20475074: 2
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca71e10>
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Finterior_boot-1774701099446.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/interior_boot-1774701099446.jpg saved to cache
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 15870409
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20251970
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720251970%27 HTTP/1.1" 200 None
2026-03-29 20:17:28 [motorway.uk] INFO: Scrape type for 20251970: 1
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 17727943
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20462595
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20192465
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20063535
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20333711
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 18068486
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20437958
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720437958%27 HTTP/1.1" 200 None
2026-03-29 20:17:28 [motorway.uk] INFO: Scrape type for 20437958: 1
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 20459514
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 18787282
2026-03-29 20:17:28 [motorway.uk] INFO: Found listing with ID: 10538324
2026-03-29 20:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0616/20130616/instrument_cluster-1774701139149.jpg> (referer: None)
2026-03-29 20:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0616/20130616/interior_rear_seats-1774701040730.jpg> (referer: None)
2026-03-29 20:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0616/20130616/interior_dashboard-1774701171464.jpg> (referer: None)
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2bb10>
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Finstrument_cluster-1774701139149.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/instrument_cluster-1774701139149.jpg saved to cache
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf06d10>
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Finterior_rear_seats-1774701040730.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/interior_rear_seats-1774701040730.jpg saved to cache
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d250250>
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Finterior_dashboard-1774701171464.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/interior_dashboard-1774701171464.jpg saved to cache
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20457094.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 with identifier: 20457094
2026-03-29 20:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 with scrape type 1
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Fexterior_front_driver-1774700246526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_driver-1774700246526.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Fexterior_rear_driver-1774700256618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_rear_driver-1774700256618.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Fexterior_front_passenger-1774700238402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_passenger-1774700238402.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7094%252F20457094%252Fexterior_rear_passenger-1774707436222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7094/20457094/exterior_rear_passenger-1774707436222.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7094%252F20457094%252Finterior_front_seats-1774702025840.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7094/20457094/interior_front_seats-1774702025840.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7094%252F20457094%252Finterior_rear_seats-1774701808994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7094/20457094/interior_rear_seats-1774701808994.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Finterior_dashboard-1774701301479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/interior_dashboard-1774701301479.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Finstrument_cluster-1774701135280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/instrument_cluster-1774701135280.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7094%252F20457094%252Finterior_boot-1774701308447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7094/20457094/interior_boot-1774701308447.jpg not downloaded yet
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7094%252F20457094%252Fdocs_service_history-1774704408973.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9885820f5d752cff39e4fcd4ccb0f6a4%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7094/20457094/docs_service_history-1774704408973.jpg?ixlib=js-3.8.0&auto=format&s=9885820f5d752cff39e4fcd4ccb0f6a4 not downloaded yet
2026-03-29 20:17:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20254074.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c729af4c-68c4-5ee4-b1f8-6bcf083faa1b with identifier: 20254074
2026-03-29 20:17:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b with scrape type 1
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Fexterior_front_driver-1774704559017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_driver-1774704559017.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Fexterior_rear_driver-1774704817015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/exterior_rear_driver-1774704817015.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Fexterior_front_passenger-1774703567690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_passenger-1774703567690.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Fexterior_rear_passenger-1774704514255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_rear_passenger-1774704514255.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Finterior_front_seats-1774703648114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/interior_front_seats-1774703648114.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Finterior_rear_seats-1774704759068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/interior_rear_seats-1774704759068.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Finterior_dashboard-1774703833735.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/interior_dashboard-1774703833735.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Finstrument_cluster-1774008077539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/instrument_cluster-1774008077539.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Finterior_boot-1774703841016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/interior_boot-1774703841016.jpg not downloaded yet
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4074%252F20254074%252Fdocs_service_history-1774009021620.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df5bd764a06cd9612517e116b4f4212ac%27 HTTP/1.1" 200 None
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4074/20254074/docs_service_history-1774009021620.jpg?ixlib=js-3.8.0&auto=format&s=f5bd764a06cd9612517e116b4f4212ac not downloaded yet
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4074/20254074/interior_boot-1774703841016.jpg> (referer: None)
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d022550>
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Finterior_boot-1774703841016.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/interior_boot-1774703841016.jpg saved to cache
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17103119.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f11cbd12-290c-5e5f-9b17-fd33bc88de75 with identifier: 17103119
2026-03-29 20:17:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f11cbd12-290c-5e5f-9b17-fd33bc88de75 with scrape type 1
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Fexterior_front_driver-1774707956608.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_front_driver-1774707956608.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Fexterior_rear_driver-1774708115249.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_driver-1774708115249.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3119%252F17103119%252F17103119-exterior_front_passenger-modified-1774709572567.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3119/17103119/17103119-exterior_front_passenger-modified-1774709572567.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Fexterior_rear_passenger-1774707922784.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_passenger-1774707922784.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3119%252F17103119%252Finterior_front_seats-1774708332886.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3119/17103119/interior_front_seats-1774708332886.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3119%252F17103119%252Finterior_rear_seats-1774708292132.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3119/17103119/interior_rear_seats-1774708292132.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3119%252F17103119%252F17103119-interior_dashboard-modified-1774709613416.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3119/17103119/17103119-interior_dashboard-modified-1774709613416.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Finstrument_cluster-1774708363472.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/instrument_cluster-1774708363472.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3119%252F17103119%252Finterior_boot-1774708403680.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3119/17103119/interior_boot-1774708403680.jpeg not downloaded yet
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3119%252F17103119%252Fdocs_service_history-1774709014241.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8b69b5e205f61624bc196f343cbe762%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3119/17103119/docs_service_history-1774709014241.jpeg?ixlib=js-3.8.0&auto=format&s=d8b69b5e205f61624bc196f343cbe762 not downloaded yet
2026-03-29 20:17:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4074/20254074/interior_dashboard-1774703833735.jpg> (referer: None)
2026-03-29 20:17:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4074/20254074/instrument_cluster-1774008077539.jpg> (referer: None)
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c210b10>
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Finterior_dashboard-1774703833735.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/interior_dashboard-1774703833735.jpg saved to cache
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58e250>
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Finstrument_cluster-1774008077539.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/instrument_cluster-1774008077539.jpg saved to cache
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:35 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (18052724) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/3119/17103119/interior_boot-1774708403680.jpeg>.
2026-03-29 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20474206.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efe996b-1fdb-5007-bfbc-54522bd793fb with identifier: 20474206
2026-03-29 20:17:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efe996b-1fdb-5007-bfbc-54522bd793fb with scrape type 1
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_front_driver-1774697294877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_driver-1774697294877.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_rear_driver-1774697307809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_driver-1774697307809.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_front_passenger-1774697329594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_passenger-1774697329594.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_rear_passenger-1774697318454.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_passenger-1774697318454.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4206%252F20474206%252Finterior_front_seats-1774697548373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4206/20474206/interior_front_seats-1774697548373.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4206%252F20474206%252Finterior_rear_seats-1774697559485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4206/20474206/interior_rear_seats-1774697559485.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Finterior_dashboard-1774697580644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/interior_dashboard-1774697580644.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Finstrument_cluster-1774697659419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/instrument_cluster-1774697659419.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4206%252F20474206%252Finterior_boot-1774697589173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4206/20474206/interior_boot-1774697589173.jpg not downloaded yet
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4206%252F20474206%252Fdocs_service_history-1774707477610.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7a24ccf5332dc4d6f5045259c676490a%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4206/20474206/docs_service_history-1774707477610.jpg?ixlib=js-3.8.0&auto=format&s=7a24ccf5332dc4d6f5045259c676490a not downloaded yet
2026-03-29 20:17:35 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/3119/17103119/interior_boot-1774708403680.jpeg>.
2026-03-29 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3119/17103119/interior_boot-1774708403680.jpeg> (referer: None)
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\n\xd67\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xa0=\x01\n\xccC\x00\x00\x00\x00'
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d022750>
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3119%252F17103119%252Finterior_boot-1774708403680.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3119/17103119/interior_boot-1774708403680.jpeg saved to cache
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3119/17103119/instrument_cluster-1774708363472.jpeg> (referer: None)
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\\\x9d\x1c\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xe5\x1f\x00\\\x93(\x00\x00\x00\x00'
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0909d0>
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Finstrument_cluster-1774708363472.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/instrument_cluster-1774708363472.jpeg saved to cache
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4206/20474206/interior_boot-1774697589173.jpg> (referer: None)
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e9210>
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4206%252F20474206%252Finterior_boot-1774697589173.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4206/20474206/interior_boot-1774697589173.jpg saved to cache
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4206/20474206/interior_dashboard-1774697580644.jpg> (referer: None)
2026-03-29 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4206/20474206/instrument_cluster-1774697659419.jpg> (referer: None)
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e091e10>
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Finterior_dashboard-1774697580644.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/interior_dashboard-1774697580644.jpg saved to cache
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca286d0>
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Finstrument_cluster-1774697659419.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/instrument_cluster-1774697659419.jpg saved to cache
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4206/20474206/interior_rear_seats-1774697559485.jpg> (referer: None)
2026-03-29 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_passenger-1774697318454.jpg> (referer: None)
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e092d10>
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4206%252F20474206%252Finterior_rear_seats-1774697559485.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4206/20474206/interior_rear_seats-1774697559485.jpg saved to cache
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc01310>
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_rear_passenger-1774697318454.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_passenger-1774697318454.jpg saved to cache
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4206/20474206/interior_front_seats-1774697548373.jpg> (referer: None)
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d594910>
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4206%252F20474206%252Finterior_front_seats-1774697548373.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4206/20474206/interior_front_seats-1774697548373.jpg saved to cache
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_passenger-1774697329594.jpg> (referer: None)
2026-03-29 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_driver-1774697307809.jpg> (referer: None)
2026-03-29 20:17:38 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16227752) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/3119/17103119/interior_rear_seats-1774708292132.jpeg>.
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d262350>
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_front_passenger-1774697329594.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_passenger-1774697329594.jpg saved to cache
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_driver-1774697294877.jpg> (referer: None)
2026-03-29 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20235497.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2500d0>
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_rear_driver-1774697307809.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_driver-1774697307809.jpg saved to cache
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc02a50>
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4206%252F20474206%252Fexterior_front_driver-1774697294877.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_driver-1774697294877.jpg saved to cache
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3efe996b-1fdb-5007-bfbc-54522bd793fb
2026-03-29 20:17:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3efe996b-1fdb-5007-bfbc-54522bd793fb, skipping ID generation
2026-03-29 20:17:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efe996b-1fdb-5007-bfbc-54522bd793fb with scrape type 1
2026-03-29 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3efe996b-1fdb-5007-bfbc-54522bd793fb sending to next pipeline
2026-03-29 20:17:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3efe996b-1fdb-5007-bfbc-54522bd793fb, identifier: 20474206
2026-03-29 20:17:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3efe996b-1fdb-5007-bfbc-54522bd793fb with identifier: 20474206
2026-03-29 20:17:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3efe996b-1fdb-5007-bfbc-54522bd793fb with identifier: 20474206
2026-03-29 20:17:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3efe996b-1fdb-5007-bfbc-54522bd793fb with identifier: 20474206 to the API
2026-03-29 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_driver-1774697294877.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3efe996b-1fdb-5007-bfbc-54522bd793fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GG67 GEM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20474206',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Porsche',
'model': 'Macan',
'odometer': 29000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2460664,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_driver-1774697294877.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2560301,
'Height': 2945,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_driver-1774697307809.jpg',
'Width': 3926},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2364474,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_front_passenger-1774697329594.jpg',
'Width': 3790},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2030170,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4206/20474206/exterior_rear_passenger-1774697318454.jpg',
'Width': 3574},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3271907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4206/20474206/interior_front_seats-1774697548373.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3674551,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4206/20474206/interior_rear_seats-1774697559485.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765648,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4206/20474206/interior_dashboard-1774697580644.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4206/20474206/instrument_cluster-1774697659419.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3efe996b-1fdb-5007-bfbc-54522bd793fb/3efe996b-1fdb-5007-bfbc-54522bd793fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4051893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4206/20474206/interior_boot-1774697589173.jpg',
'Width': 4032}],
'price': 33662,
'price_includes_vat': False,
'registration_date': '2019-05-24',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S S-A',
'transmission': 'automatic',
'trim': 'S S-A',
'vin': 'WP1ZZZ95ZKLB25938',
'year': 2019}
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474206%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [motorway.uk] INFO: Saving data for 20474206: {'created_time': 1774815459.175067, 'last_price_update_time': 1774815459.175077, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20474206') HTTP/1.1" 204 0
2026-03-29 20:17:39 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16341847) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/3119/17103119/interior_front_seats-1774708332886.jpeg>.
2026-03-29 20:17:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc with identifier: 20235497
2026-03-29 20:17:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc with scrape type 1
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Fexterior_front_driver-1774634624500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_front_driver-1774634624500.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Fexterior_rear_driver-1774634659469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_driver-1774634659469.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5497%252F20235497%252Fexterior_front_passenger-1774688661467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5497/20235497/exterior_front_passenger-1774688661467.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Fexterior_rear_passenger-1774634688677.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_passenger-1774634688677.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F20235497%252Finterior_front_seats-1774635291420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/20235497/interior_front_seats-1774635291420.jpg not downloaded yet
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F20235497%252Finterior_rear_seats-1774635332424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/20235497/interior_rear_seats-1774635332424.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Finterior_dashboard-1774635432508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/interior_dashboard-1774635432508.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F20235497%252Finterior_boot-1774635375816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/20235497/interior_boot-1774635375816.jpg not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5497%252F20235497%252Fdocs_service_history-1774635980083.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D554ba37b454fb84b3fad46eb4209975e%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5497/20235497/docs_service_history-1774635980083.jpg?ixlib=js-3.8.0&auto=format&s=554ba37b454fb84b3fad46eb4209975e not downloaded yet
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5497%252F20235497%252Fdocs_service_history-1774635980193.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db98b35ccc9b3637d27d838c4f67e4454%27 HTTP/1.1" 200 None
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5497/20235497/docs_service_history-1774635980193.jpg?ixlib=js-3.8.0&auto=format&s=b98b35ccc9b3637d27d838c4f67e4454 not downloaded yet
2026-03-29 20:17:39 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/3119/17103119/interior_rear_seats-1774708292132.jpeg>.
2026-03-29 20:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_passenger-1774707922784.jpeg> (referer: None)
2026-03-29 20:17:39 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/3119/17103119/interior_front_seats-1774708332886.jpeg>.
2026-03-29 20:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3119/17103119/interior_rear_seats-1774708292132.jpeg> (referer: None)
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eade110>
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Fexterior_rear_passenger-1774707922784.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_passenger-1774707922784.jpeg saved to cache
2026-03-29 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:39 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:17:39 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:17:39 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xecn\xce\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0b.\xda\x00\xecd\xda\x00\x00\x00\x00'
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf071d0>
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3119%252F17103119%252Finterior_rear_seats-1774708292132.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3119/17103119/interior_rear_seats-1774708292132.jpeg saved to cache
2026-03-29 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3119/17103119/interior_front_seats-1774708332886.jpeg> (referer: None)
2026-03-29 20:17:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:17:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:17:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xec(\xb3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\r2\xa4\x00\xec\x1e\xbf\x00\x00\x00\x00'
2026-03-29 20:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad5050>
2026-03-29 20:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3119%252F17103119%252Finterior_front_seats-1774708332886.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3119/17103119/interior_front_seats-1774708332886.jpeg saved to cache
2026-03-29 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20185351.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5497/20235497/interior_boot-1774635375816.jpg> (referer: None)
2026-03-29 20:17:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873c4344-5da8-5f67-ad62-777f38fe21d7 with identifier: 20185351
2026-03-29 20:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873c4344-5da8-5f67-ad62-777f38fe21d7 with scrape type 1
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_front_driver-1774777585915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_driver-1774777585915.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_rear_driver-1774197616393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_driver-1774197616393.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_front_passenger-1774197880023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_passenger-1774197880023.jpg not downloaded yet
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22d3d0>
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F20235497%252Finterior_boot-1774635375816.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/20235497/interior_boot-1774635375816.jpg saved to cache
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_rear_passenger-1774197600695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_passenger-1774197600695.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5351%252F20185351%252Finterior_front_seats-1774198441253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5351/20185351/interior_front_seats-1774198441253.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5351%252F20185351%252Finterior_rear_seats-1774198435714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5351/20185351/interior_rear_seats-1774198435714.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Finterior_dashboard-1774198447255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/interior_dashboard-1774198447255.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5351%252F20185351%252Finterior_boot-1774198438469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5351/20185351/interior_boot-1774198438469.jpg not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5351%252F20185351%252Fdocs_service_history-1774777463348.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d8837d2cb44c5d76faaf377dfe8f0b5%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5351/20185351/docs_service_history-1774777463348.jpg?ixlib=js-3.8.0&auto=format&s=2d8837d2cb44c5d76faaf377dfe8f0b5 not downloaded yet
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5351%252F20185351%252Fdocs_service_history-1774777481335.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a9872cb9ad299b269abe0e81b5298aa%27 HTTP/1.1" 200 None
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5351/20185351/docs_service_history-1774777481335.jpg?ixlib=js-3.8.0&auto=format&s=0a9872cb9ad299b269abe0e81b5298aa not downloaded yet
2026-03-29 20:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5497/20235497/interior_rear_seats-1774635332424.jpg> (referer: None)
2026-03-29 20:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5497/20235497/interior_front_seats-1774635291420.jpg> (referer: None)
2026-03-29 20:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/20235497/interior_dashboard-1774635432508.jpg> (referer: None)
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d9790>
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F20235497%252Finterior_rear_seats-1774635332424.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/20235497/interior_rear_seats-1774635332424.jpg saved to cache
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d117350>
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5497%252F20235497%252Finterior_front_seats-1774635291420.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5497/20235497/interior_front_seats-1774635291420.jpg saved to cache
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d055f50>
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Finterior_dashboard-1774635432508.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/interior_dashboard-1774635432508.jpg saved to cache
2026-03-29 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5351/20185351/interior_rear_seats-1774198435714.jpg> (referer: None)
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5351/20185351/interior_front_seats-1774198441253.jpg> (referer: None)
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c230c10>
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5351%252F20185351%252Finterior_rear_seats-1774198435714.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5351/20185351/interior_rear_seats-1774198435714.jpg saved to cache
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5351/20185351/interior_boot-1774198438469.jpg> (referer: None)
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d023110>
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5351%252F20185351%252Finterior_front_seats-1774198441253.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5351/20185351/interior_front_seats-1774198441253.jpg saved to cache
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d261a90>
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5351%252F20185351%252Finterior_boot-1774198438469.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5351/20185351/interior_boot-1774198438469.jpg saved to cache
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5351/20185351/interior_dashboard-1774198447255.jpg> (referer: None)
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_passenger-1774197600695.jpg> (referer: None)
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d117e10>
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Finterior_dashboard-1774198447255.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/interior_dashboard-1774198447255.jpg saved to cache
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 873c4344-5da8-5f67-ad62-777f38fe21d7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 873c4344-5da8-5f67-ad62-777f38fe21d7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093ed0>
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_rear_passenger-1774197600695.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_passenger-1774197600695.jpg saved to cache
2026-03-29 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_driver-1774777585915.jpg> (referer: None)
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_passenger-1774197880023.jpg> (referer: None)
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_driver-1774197616393.jpg> (referer: None)
2026-03-29 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_passenger-1774634688677.jpg> (referer: None)
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cedf410>
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_front_driver-1774777585915.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_driver-1774777585915.jpg saved to cache
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc57d0>
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_front_passenger-1774197880023.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_passenger-1774197880023.jpg saved to cache
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce49e10>
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5351%252F20185351%252Fexterior_rear_driver-1774197616393.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_driver-1774197616393.jpg saved to cache
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 873c4344-5da8-5f67-ad62-777f38fe21d7
2026-03-29 20:17:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 873c4344-5da8-5f67-ad62-777f38fe21d7, skipping ID generation
2026-03-29 20:17:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873c4344-5da8-5f67-ad62-777f38fe21d7 with scrape type 1
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 873c4344-5da8-5f67-ad62-777f38fe21d7 sending to next pipeline
2026-03-29 20:17:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 873c4344-5da8-5f67-ad62-777f38fe21d7, identifier: 20185351
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceccd50>
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Fexterior_rear_passenger-1774634688677.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_passenger-1774634688677.jpg saved to cache
2026-03-29 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 873c4344-5da8-5f67-ad62-777f38fe21d7 with identifier: 20185351
2026-03-29 20:17:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 873c4344-5da8-5f67-ad62-777f38fe21d7 with identifier: 20185351
2026-03-29 20:17:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 873c4344-5da8-5f67-ad62-777f38fe21d7 with identifier: 20185351 to the API
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_driver-1774197616393.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '873c4344-5da8-5f67-ad62-777f38fe21d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FV65 MMJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20185351',
'listing': 'auction',
'location': 'Hertfordshire Potters Bar',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 57000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1802223,
'Height': 2858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_driver-1774777585915.jpg',
'Width': 3811},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1594463,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_driver-1774197616393.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1946024,
'Height': 2824,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_front_passenger-1774197880023.jpg',
'Width': 3765},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1610110,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5351/20185351/exterior_rear_passenger-1774197600695.jpg',
'Width': 3563},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2535376,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/5351/20185351/interior_front_seats-1774198441253.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011088,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/5351/20185351/interior_rear_seats-1774198435714.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1863824,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5351/20185351/interior_dashboard-1774198447255.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_873c4344-5da8-5f67-ad62-777f38fe21d7/873c4344-5da8-5f67-ad62-777f38fe21d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2916491,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/5351/20185351/interior_boot-1774198438469.jpg',
'Width': 3840}],
'price': 12537,
'price_includes_vat': False,
'registration_date': '2015-12-08',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C200 AMG Line Premium + Auto',
'transmission': 'automatic',
'trim': 'C200 AMG Line Premium + Auto',
'vin': 'WDD2050422R113431',
'year': 2015}
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720185351%27 HTTP/1.1" 200 None
2026-03-29 20:17:43 [motorway.uk] INFO: Saving data for 20185351: {'created_time': 1774815463.998536, 'last_price_update_time': 1774815463.998547, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20185351') HTTP/1.1" 204 0
2026-03-29 20:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=396&page=11&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_driver-1774634659469.jpg> (referer: None)
2026-03-29 20:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_front_driver-1774634624500.jpg> (referer: None)
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 18237479
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718237479%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 18237479: 1
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20424370
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720424370%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 20424370: 1
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 10385844
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20023878
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720023878%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 20023878: 1
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d261e10>
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Fexterior_rear_driver-1774634659469.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_driver-1774634659469.jpg saved to cache
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d178510>
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5497%252F20235497%252Fexterior_front_driver-1774634624500.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_front_driver-1774634624500.jpg saved to cache
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc
2026-03-29 20:17:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc, skipping ID generation
2026-03-29 20:17:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc with scrape type 1
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc sending to next pipeline
2026-03-29 20:17:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc, identifier: 20235497
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20463571
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19486980
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719486980%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 19486980: 1
2026-03-29 20:17:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc with identifier: 20235497
2026-03-29 20:17:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc with identifier: 20235497
2026-03-29 20:17:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0f5ffb0a-a806-5589-ba17-3b34d75bf9dc with identifier: 20235497 to the API
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_front_driver-1774634624500.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0f5ffb0a-a806-5589-ba17-3b34d75bf9dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD21 JFA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20235497',
'listing': 'auction',
'location': 'Greater Manchester Rochdale',
'make': 'Audi',
'model': 'A1',
'odometer': 36273,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476632,
'Height': 2718,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_front_driver-1774634624500.jpg',
'Width': 3624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 923991,
'Height': 2045,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_driver-1774634659469.jpg',
'Width': 2727},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677452,
'Height': 2683,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5497/20235497/exterior_rear_passenger-1774634688677.jpg',
'Width': 3577},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677520,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5497/20235497/interior_front_seats-1774635291420.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2536265,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5497/20235497/interior_rear_seats-1774635332424.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3397116,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5497/20235497/interior_dashboard-1774635432508.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5ffb0a-a806-5589-ba17-3b34d75bf9dc/0f5ffb0a-a806-5589-ba17-3b34d75bf9dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2713885,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5497/20235497/interior_boot-1774635375816.jpg',
'Width': 4032}],
'price': 11488,
'price_includes_vat': False,
'registration_date': '2021-06-17',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Technik 25 TFSI',
'transmission': 'manual',
'trim': 'Technik 25 TFSI',
'vin': 'WAUZZZGB4MR060032',
'year': 2021}
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235497%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Saving data for 20235497: {'created_time': 1774815464.889045, 'last_price_update_time': 1774815464.889055, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20235497') HTTP/1.1" 204 0
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 7743070
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 11675984
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 11431082
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20466900
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20422527
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20080388
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720080388%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 20080388: 1
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 12887188
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712887188%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 12887188: 1
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20469058
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19693972
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719693972%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 19693972: 1
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19713173
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19370782
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19687443
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19280379
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20156431
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 19905808
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20454140
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20386729
2026-03-29 20:17:44 [motorway.uk] INFO: Found listing with ID: 20000898
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720000898%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [motorway.uk] INFO: Scrape type for 20000898: 1
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20501153
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20416082
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 18349950
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20300016
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 11716723
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20488257
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488257%27 HTTP/1.1" 200 None
2026-03-29 20:17:45 [motorway.uk] INFO: Scrape type for 20488257: 1
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 8670436
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20266056
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20449935
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720449935%27 HTTP/1.1" 200 None
2026-03-29 20:17:45 [motorway.uk] INFO: Scrape type for 20449935: 1
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20429190
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 20031424
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720031424%27 HTTP/1.1" 200 None
2026-03-29 20:17:45 [motorway.uk] INFO: Scrape type for 20031424: 1
2026-03-29 20:17:45 [motorway.uk] INFO: Found listing with ID: 14826836
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714826836%27 HTTP/1.1" 200 None
2026-03-29 20:17:45 [motorway.uk] INFO: Scrape type for 14826836: 1
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_rear_passenger-1774704514255.jpg> (referer: None)
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_passenger-1774703567690.jpg> (referer: None)
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4074/20254074/interior_front_seats-1774703648114.jpg> (referer: None)
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_front_driver-1774707956608.jpeg> (referer: None)
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4074/20254074/interior_rear_seats-1774704759068.jpg> (referer: None)
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_driver-1774708115249.jpeg> (referer: None)
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d178f50>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Fexterior_rear_passenger-1774704514255.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_rear_passenger-1774704514255.jpg saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c3a10>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Fexterior_front_passenger-1774703567690.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_passenger-1774703567690.jpg saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0383d0>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Finterior_front_seats-1774703648114.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/interior_front_seats-1774703648114.jpg saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1b750>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Fexterior_front_driver-1774707956608.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_front_driver-1774707956608.jpeg saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03a1d0>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Finterior_rear_seats-1774704759068.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/interior_rear_seats-1774704759068.jpg saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e066590>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3119%252F17103119%252Fexterior_rear_driver-1774708115249.jpeg') HTTP/1.1" 204 0
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_driver-1774708115249.jpeg saved to cache
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f11cbd12-290c-5e5f-9b17-fd33bc88de75
2026-03-29 20:17:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f11cbd12-290c-5e5f-9b17-fd33bc88de75, skipping ID generation
2026-03-29 20:17:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f11cbd12-290c-5e5f-9b17-fd33bc88de75 with scrape type 1
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f11cbd12-290c-5e5f-9b17-fd33bc88de75 sending to next pipeline
2026-03-29 20:17:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f11cbd12-290c-5e5f-9b17-fd33bc88de75, identifier: 17103119
2026-03-29 20:17:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f11cbd12-290c-5e5f-9b17-fd33bc88de75 with identifier: 17103119
2026-03-29 20:17:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f11cbd12-290c-5e5f-9b17-fd33bc88de75 with identifier: 17103119
2026-03-29 20:17:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f11cbd12-290c-5e5f-9b17-fd33bc88de75 with identifier: 17103119 to the API
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_driver-1774708115249.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f11cbd12-290c-5e5f-9b17-fd33bc88de75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV19 JDO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17103119',
'listing': 'auction',
'location': 'Hampshire Yateley',
'make': 'SEAT',
'model': 'Ibiza',
'odometer': 39871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5730965,
'Height': 4973,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_front_driver-1774707956608.jpeg',
'Width': 6630},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6518046,
'Height': 5219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_driver-1774708115249.jpeg',
'Width': 6958},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5171934,
'Height': 4977,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3119/17103119/exterior_rear_passenger-1774707922784.jpeg',
'Width': 6636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16341847,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/3119/17103119/interior_front_seats-1774708332886.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16227752,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/3119/17103119/interior_rear_seats-1774708292132.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 6390331,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3119/17103119/instrument_cluster-1774708363472.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11cbd12-290c-5e5f-9b17-fd33bc88de75/f11cbd12-290c-5e5f-9b17-fd33bc88de75_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 18052724,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/3119/17103119/interior_boot-1774708403680.jpeg',
'Width': 8064}],
'price': 9311,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Ibiza Xcellence TSI',
'transmission': 'manual',
'trim': 'Xcellence TSI',
'vin': 'VSSZZZKJZKR111872',
'year': 2019}
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717103119%27 HTTP/1.1" 200 None
2026-03-29 20:17:46 [motorway.uk] INFO: Saving data for 17103119: {'created_time': 1774815466.584798, 'last_price_update_time': 1774815466.58481, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17103119') HTTP/1.1" 204 0
2026-03-29 20:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20437958.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b0a60b-1521-5738-864e-d4c0e3e0a215 with identifier: 20437958
2026-03-29 20:17:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b0a60b-1521-5738-864e-d4c0e3e0a215 with scrape type 1
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_front_driver-1774608604932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_driver-1774608604932.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_rear_driver-1774608646191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_driver-1774608646191.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_front_passenger-1774608689333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_passenger-1774608689333.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_rear_passenger-1774608663563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_passenger-1774608663563.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7958%252F20437958%252Finterior_front_seats-1774690973795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7958/20437958/interior_front_seats-1774690973795.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7958%252F20437958%252Finterior_rear_seats-1774691352858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7958/20437958/interior_rear_seats-1774691352858.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7958%252F20437958%252Finterior_dashboard-1774692599460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7958/20437958/interior_dashboard-1774692599460.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Finstrument_cluster-1774627821447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/instrument_cluster-1774627821447.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7958%252F20437958%252Finterior_boot-1774627802653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7958/20437958/interior_boot-1774627802653.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7958%252F20437958%252Fdocs_service_history-1774693163126.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D78d36b8bf192b3fa90d0ca689abf8e0e%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7958/20437958/docs_service_history-1774693163126.jpg?ixlib=js-3.8.0&auto=format&s=78d36b8bf192b3fa90d0ca689abf8e0e not downloaded yet
2026-03-29 20:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9706336.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8929d53c-a24f-5a84-b37a-f03edbc71b4f with identifier: 9706336
2026-03-29 20:17:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f with scrape type 1
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_front_driver-1774519015033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_driver-1774519015033.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_rear_driver-1774519002085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_driver-1774519002085.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_front_passenger-1774519026497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_passenger-1774519026497.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_rear_passenger-1774519010868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_passenger-1774519010868.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6336%252F9706336%252Finterior_front_seats-1774519485544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6336/9706336/interior_front_seats-1774519485544.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6336%252F9706336%252Finterior_rear_seats-1774519647681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6336/9706336/interior_rear_seats-1774519647681.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Finterior_dashboard-1774519537486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/interior_dashboard-1774519537486.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Finstrument_cluster-1774519574988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/instrument_cluster-1774519574988.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6336%252F9706336%252Finterior_boot-1774519544457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6336/9706336/interior_boot-1774519544457.jpg not downloaded yet
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6336%252F9706336%252Fdocs_service_history-1774546282038.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D54fd4939e74478dd7a246aef6cc8d105%27 HTTP/1.1" 200 None
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6336/9706336/docs_service_history-1774546282038.jpg?ixlib=js-3.8.0&auto=format&s=54fd4939e74478dd7a246aef6cc8d105 not downloaded yet
2026-03-29 20:17:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6336/9706336/interior_boot-1774519544457.jpg> (referer: None)
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca5f310>
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6336%252F9706336%252Finterior_boot-1774519544457.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6336/9706336/interior_boot-1774519544457.jpg saved to cache
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6336/9706336/instrument_cluster-1774519574988.jpg> (referer: None)
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d17b390>
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Finstrument_cluster-1774519574988.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/instrument_cluster-1774519574988.jpg saved to cache
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6336/9706336/interior_dashboard-1774519537486.jpg> (referer: None)
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d289e90>
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Finterior_dashboard-1774519537486.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/interior_dashboard-1774519537486.jpg saved to cache
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19465246.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad12ce25-8e65-5341-a211-97668485c83f with identifier: 19465246
2026-03-29 20:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad12ce25-8e65-5341-a211-97668485c83f with scrape type 1
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_front_driver-1774690599576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_driver-1774690599576.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_rear_driver-1774690647143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_driver-1774690647143.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_front_passenger-1774690662399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_passenger-1774690662399.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_rear_passenger-1774690640376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_passenger-1774690640376.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5246%252F19465246%252Finterior_front_seats-1774691183227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5246/19465246/interior_front_seats-1774691183227.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5246%252F19465246%252Finterior_rear_seats-1774691306805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5246/19465246/interior_rear_seats-1774691306805.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Finterior_dashboard-1774691352709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/interior_dashboard-1774691352709.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5246%252F19465246%252Finstrument_cluster-1774692668706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5246/19465246/instrument_cluster-1774692668706.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5246%252F19465246%252Finterior_boot-1774691448568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5246/19465246/interior_boot-1774691448568.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5246%252F19465246%252Fdocs_service_history-1774691668622.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e8fa26e95e9652d53fa36e1c6305ae5%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5246/19465246/docs_service_history-1774691668622.jpg?ixlib=js-3.8.0&auto=format&s=5e8fa26e95e9652d53fa36e1c6305ae5 not downloaded yet
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6336/9706336/interior_rear_seats-1774519647681.jpg> (referer: None)
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6336/9706336/interior_front_seats-1774519485544.jpg> (referer: None)
2026-03-29 20:17:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d7450>
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6336%252F9706336%252Finterior_rear_seats-1774519647681.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6336/9706336/interior_rear_seats-1774519647681.jpg saved to cache
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20251970.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d6fd0>
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6336%252F9706336%252Finterior_front_seats-1774519485544.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6336/9706336/interior_front_seats-1774519485544.jpg saved to cache
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:17:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 with identifier: 20251970
2026-03-29 20:17:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 with scrape type 1
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_front_driver-1774712313332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_driver-1774712313332.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_rear_driver-1774712329033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_driver-1774712329033.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_front_passenger-1774712375005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_passenger-1774712375005.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_rear_passenger-1774712355163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_passenger-1774712355163.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1970%252F20251970%252Finterior_front_seats-1774712663111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1970/20251970/interior_front_seats-1774712663111.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1970%252F20251970%252Finterior_rear_seats-1774712682691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1970/20251970/interior_rear_seats-1774712682691.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Finterior_dashboard-1774712776632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/interior_dashboard-1774712776632.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1970%252F20251970%252Finterior_boot-1774712720376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1970/20251970/interior_boot-1774712720376.jpg not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1970%252F20251970%252Fdocs_service_history-1774714545040.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D60d864b3def2704a03ae8bac35a7a7d3%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1970/20251970/docs_service_history-1774714545040.jpg?ixlib=js-3.8.0&auto=format&s=60d864b3def2704a03ae8bac35a7a7d3 not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1970%252F20251970%252Fdocs_service_history-1774714545031.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dec91fef9c79440bc260f10bba6bf4dce%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1970/20251970/docs_service_history-1774714545031.jpg?ixlib=js-3.8.0&auto=format&s=ec91fef9c79440bc260f10bba6bf4dce not downloaded yet
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5246/19465246/interior_boot-1774691448568.jpg> (referer: None)
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e081250>
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5246%252F19465246%252Finterior_boot-1774691448568.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5246/19465246/interior_boot-1774691448568.jpg saved to cache
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item ad12ce25-8e65-5341-a211-97668485c83f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item ad12ce25-8e65-5341-a211-97668485c83f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1970/20251970/interior_boot-1774712720376.jpg> (referer: None)
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24c650>
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1970%252F20251970%252Finterior_boot-1774712720376.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1970/20251970/interior_boot-1774712720376.jpg saved to cache
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1970/20251970/interior_dashboard-1774712776632.jpg> (referer: None)
2026-03-29 20:17:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1970/20251970/interior_rear_seats-1774712682691.jpg> (referer: None)
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c233190>
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Finterior_dashboard-1774712776632.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/interior_dashboard-1774712776632.jpg saved to cache
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24ced0>
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1970%252F20251970%252Finterior_rear_seats-1774712682691.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1970/20251970/interior_rear_seats-1774712682691.jpg saved to cache
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1970/20251970/interior_front_seats-1774712663111.jpg> (referer: None)
2026-03-29 20:17:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_passenger-1774712355163.jpg> (referer: None)
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2e510>
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1970%252F20251970%252Finterior_front_seats-1774712663111.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1970/20251970/interior_front_seats-1774712663111.jpg saved to cache
2026-03-29 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c246b10>
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_rear_passenger-1774712355163.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_passenger-1774712355163.jpg saved to cache
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_passenger-1774712375005.jpg> (referer: None)
2026-03-29 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_driver-1774712329033.jpg> (referer: None)
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f09590>
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_front_passenger-1774712375005.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_passenger-1774712375005.jpg saved to cache
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2da4d0>
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_rear_driver-1774712329033.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_driver-1774712329033.jpg saved to cache
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20237507.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_driver-1774712313332.jpg> (referer: None)
2026-03-29 20:17:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddfc6a92-8aed-5735-b674-a974bbc41dd0 with identifier: 20237507
2026-03-29 20:17:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddfc6a92-8aed-5735-b674-a974bbc41dd0 with scrape type 1
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddfc6a92-8aed-5735-b674-a974bbc41dd0
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Fexterior_front_driver-1774691106950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_driver-1774691106950.jpg not downloaded yet
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Fexterior_rear_driver-1774691162910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_rear_driver-1774691162910.jpg not downloaded yet
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2685d0>
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1970%252F20251970%252Fexterior_front_driver-1774712313332.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_driver-1774712313332.jpg saved to cache
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3
2026-03-29 20:17:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41d8255d-40eb-59e6-a0a3-e2805fb37dd3, skipping ID generation
2026-03-29 20:17:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 with scrape type 1
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 sending to next pipeline
2026-03-29 20:17:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 41d8255d-40eb-59e6-a0a3-e2805fb37dd3, identifier: 20251970
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Fexterior_front_passenger-1774691129920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_passenger-1774691129920.jpg not downloaded yet
2026-03-29 20:17:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 with identifier: 20251970
2026-03-29 20:17:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 with identifier: 20251970
2026-03-29 20:17:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 41d8255d-40eb-59e6-a0a3-e2805fb37dd3 with identifier: 20251970 to the API
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_driver-1774712313332.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '41d8255d-40eb-59e6-a0a3-e2805fb37dd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HX22 YKL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20251970',
'listing': 'auction',
'location': 'Hampshire Fareham',
'make': 'MG',
'model': 'ZS',
'odometer': 22730,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1829278,
'Height': 2638,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_driver-1774712313332.jpg',
'Width': 3517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1728361,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_driver-1774712329033.jpg',
'Width': 3479},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672888,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_front_passenger-1774712375005.jpg',
'Width': 3486},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2256829,
'Height': 3001,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1970/20251970/exterior_rear_passenger-1774712355163.jpg',
'Width': 4001},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3711794,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1970/20251970/interior_front_seats-1774712663111.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3003762,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1970/20251970/interior_rear_seats-1774712682691.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3460639,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1970/20251970/interior_dashboard-1774712776632.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d8255d-40eb-59e6-a0a3-e2805fb37dd3/41d8255d-40eb-59e6-a0a3-e2805fb37dd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3564438,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1970/20251970/interior_boot-1774712720376.jpg',
'Width': 4032}],
'price': 11325,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seats_number': None,
'seller_name': None,
'title': 'MG ZS Excite T-GDi Auto',
'transmission': 'automatic',
'trim': 'Excite T-GDi Auto',
'vin': 'LSJW74C91NZ176807',
'year': 2022}
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720251970%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [motorway.uk] INFO: Saving data for 20251970: {'created_time': 1774815477.353658, 'last_price_update_time': 1774815477.353669, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20251970') HTTP/1.1" 204 0
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7507%252F20237507%252F20237507-exterior_rear_passenger-modified-1774696313778.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7507/20237507/20237507-exterior_rear_passenger-modified-1774696313778.jpeg not downloaded yet
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7507%252F20237507%252F20237507-interior_front_seats-modified-1774695978139.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7507/20237507/20237507-interior_front_seats-modified-1774695978139.jpeg not downloaded yet
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7507%252F20237507%252F20237507-interior_dashboard-modified-1774695929806.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7507/20237507/20237507-interior_dashboard-modified-1774695929806.jpeg not downloaded yet
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Finstrument_cluster-1774694618955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/instrument_cluster-1774694618955.jpg not downloaded yet
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7507%252F20237507%252F20237507-interior_boot-default-1774695939721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7507/20237507/20237507-interior_boot-default-1774695939721.jpg not downloaded yet
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7507%252F20237507%252Fdocs_service_history-1774695307552.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1520325b0ba040dac2e7a8b16e28f68%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7507/20237507/docs_service_history-1774695307552.jpg?ixlib=js-3.8.0&auto=format&s=f1520325b0ba040dac2e7a8b16e28f68 not downloaded yet
2026-03-29 20:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5246/19465246/interior_dashboard-1774691352709.jpg> (referer: None)
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7507%252F20237507%252Fdocs_service_history-1774695348364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0168d06c46ecb75c4156e70c54bd6436%27 HTTP/1.1" 200 None
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7507/20237507/docs_service_history-1774695348364.jpg?ixlib=js-3.8.0&auto=format&s=0168d06c46ecb75c4156e70c54bd6436 not downloaded yet
2026-03-29 20:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_passenger-1774690640376.jpg> (referer: None)
2026-03-29 20:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5246/19465246/interior_rear_seats-1774691306805.jpg> (referer: None)
2026-03-29 20:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5246/19465246/interior_front_seats-1774691183227.jpg> (referer: None)
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22ebd0>
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Finterior_dashboard-1774691352709.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/interior_dashboard-1774691352709.jpg saved to cache
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca3fa90>
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_rear_passenger-1774690640376.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_passenger-1774690640376.jpg saved to cache
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc00d50>
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5246%252F19465246%252Finterior_rear_seats-1774691306805.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5246/19465246/interior_rear_seats-1774691306805.jpg saved to cache
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5977d0>
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5246%252F19465246%252Finterior_front_seats-1774691183227.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5246/19465246/interior_front_seats-1774691183227.jpg saved to cache
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20475074.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7507/20237507/20237507-interior_boot-default-1774695939721.jpg> (referer: None)
2026-03-29 20:17:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bd6f9d-774e-58ae-81ef-02cf6c4b7836 with identifier: 20475074
2026-03-29 20:17:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bd6f9d-774e-58ae-81ef-02cf6c4b7836 with scrape type 2
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74bd6f9d-774e-58ae-81ef-02cf6c4b7836 with scrape type 2
2026-03-29 20:17:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 74bd6f9d-774e-58ae-81ef-02cf6c4b7836, identifier: 20475074
2026-03-29 20:17:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 74bd6f9d-774e-58ae-81ef-02cf6c4b7836 with identifier: 20475074
2026-03-29 20:17:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 74bd6f9d-774e-58ae-81ef-02cf6c4b7836 with identifier: 20475074
2026-03-29 20:17:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 74bd6f9d-774e-58ae-81ef-02cf6c4b7836 with identifier: 20475074 to the API
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20475074.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '74bd6f9d-774e-58ae-81ef-02cf6c4b7836',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW20 UTB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20475074',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Ford',
'model': 'Transit',
'odometer': 69000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 9571,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Custom 340 Base',
'transmission': 'manual',
'trim': 'Custom 340 Base',
'vin': 'WF0YXXTTGYKK75173',
'year': 2020}
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475074%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [motorway.uk] INFO: Saving data for 20475074: {'auction_closing_time': 1774884600.0, 'created_time': 1774728963.471959, 'last_price_update_time': 1774815478.833532}
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20475074') HTTP/1.1" 204 0
2026-03-29 20:17:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6ee50>
2026-03-29 20:17:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7507%252F20237507%252F20237507-interior_boot-default-1774695939721.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7507/20237507/20237507-interior_boot-default-1774695939721.jpg saved to cache
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7507/20237507/instrument_cluster-1774694618955.jpg> (referer: None)
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d163c50>
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Finstrument_cluster-1774694618955.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/instrument_cluster-1774694618955.jpg saved to cache
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_rear_driver-1774691162910.jpg> (referer: None)
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_passenger-1774691129920.jpg> (referer: None)
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad6bd0>
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Fexterior_rear_driver-1774691162910.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_rear_driver-1774691162910.jpg saved to cache
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d161e10>
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Fexterior_front_passenger-1774691129920.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_passenger-1774691129920.jpg saved to cache
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_driver-1774691106950.jpg> (referer: None)
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_passenger-1774690662399.jpg> (referer: None)
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1b690>
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7507%252F20237507%252Fexterior_front_driver-1774691106950.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_driver-1774691106950.jpg saved to cache
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_driver-1774690647143.jpg> (referer: None)
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e091910>
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_front_passenger-1774690662399.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_passenger-1774690662399.jpg saved to cache
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e080790>
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_rear_driver-1774690647143.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_driver-1774690647143.jpg saved to cache
2026-03-29 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_driver-1774690599576.jpg> (referer: None)
2026-03-29 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_driver-1774519002085.jpg> (referer: None)
2026-03-29 20:18:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_passenger-1774519026497.jpg> (referer: None)
2026-03-29 20:18:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_passenger-1774519010868.jpg> (referer: None)
2026-03-29 20:18:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e95d0>
2026-03-29 20:18:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5246%252F19465246%252Fexterior_front_driver-1774690599576.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_driver-1774690599576.jpg saved to cache
2026-03-29 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad12ce25-8e65-5341-a211-97668485c83f
2026-03-29 20:18:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad12ce25-8e65-5341-a211-97668485c83f, skipping ID generation
2026-03-29 20:18:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad12ce25-8e65-5341-a211-97668485c83f with scrape type 1
2026-03-29 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad12ce25-8e65-5341-a211-97668485c83f sending to next pipeline
2026-03-29 20:18:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ad12ce25-8e65-5341-a211-97668485c83f, identifier: 19465246
2026-03-29 20:18:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ad12ce25-8e65-5341-a211-97668485c83f with identifier: 19465246
2026-03-29 20:18:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ad12ce25-8e65-5341-a211-97668485c83f with identifier: 19465246
2026-03-29 20:18:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ad12ce25-8e65-5341-a211-97668485c83f with identifier: 19465246 to the API
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_driver-1774690599576.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'ad12ce25-8e65-5341-a211-97668485c83f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD23 FAM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19465246',
'listing': 'auction',
'location': 'Derbyshire High Peak',
'make': 'Volvo',
'model': 'XC60',
'odometer': 27400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1704186,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_driver-1774690599576.jpg',
'Width': 3326},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1718841,
'Height': 2575,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_driver-1774690647143.jpg',
'Width': 3433},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1725468,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_front_passenger-1774690662399.jpg',
'Width': 3250},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1744386,
'Height': 2598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5246/19465246/exterior_rear_passenger-1774690640376.jpg',
'Width': 3464},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3597857,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5246/19465246/interior_front_seats-1774691183227.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3565243,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5246/19465246/interior_rear_seats-1774691306805.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3231782,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5246/19465246/interior_dashboard-1774691352709.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad12ce25-8e65-5341-a211-97668485c83f/ad12ce25-8e65-5341-a211-97668485c83f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3246892,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5246/19465246/interior_boot-1774691448568.jpg',
'Width': 4032}],
'price': 26511,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 Core B5 MHEV AWD Auto',
'transmission': 'automatic',
'trim': 'Core B5 MHEV AWD Auto',
'vin': 'YV1UZL1V3R1713351',
'year': 2023}
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719465246%27 HTTP/1.1" 200 None
2026-03-29 20:18:00 [motorway.uk] INFO: Saving data for 19465246: {'created_time': 1774815480.632656, 'last_price_update_time': 1774815480.632667, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19465246') HTTP/1.1" 204 0
2026-03-29 20:18:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ddfc6a92-8aed-5735-b674-a974bbc41dd0 with identifier: 20237507
2026-03-29 20:18:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ddfc6a92-8aed-5735-b674-a974bbc41dd0 with identifier: 20237507
2026-03-29 20:18:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ddfc6a92-8aed-5735-b674-a974bbc41dd0 with identifier: 20237507 to the API
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:01 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ddfc6a92-8aed-5735-b674-a974bbc41dd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VA19 KFO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20237507',
'listing': 'auction',
'location': 'Essex Dunmow',
'make': 'Vauxhall',
'model': 'Vivaro',
'odometer': 99546,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_driver-1774691106950.jpg',
'https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_rear_driver-1774691162910.jpg',
'https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_passenger-1774691129920.jpg',
'https://motorway-photos-modified.imgix.net/7507/20237507/20237507-exterior_rear_passenger-modified-1774696313778.jpeg',
'https://motorway-photos-modified.imgix.net/7507/20237507/20237507-interior_front_seats-modified-1774695978139.jpeg',
'https://motorway-photos-modified.imgix.net/7507/20237507/20237507-interior_dashboard-modified-1774695929806.jpeg',
'https://motorway-photos-redacted.imgix.net/7507/20237507/instrument_cluster-1774694618955.jpg',
'https://motorway-photos.imgix.net/7507/20237507/20237507-interior_boot-default-1774695939721.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/7507/20237507/docs_service_history-1774695307552.jpg?ixlib=js-3.8.0&auto=format&s=f1520325b0ba040dac2e7a8b16e28f68',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/7507/20237507/docs_service_history-1774695348364.jpg?ixlib=js-3.8.0&auto=format&s=0168d06c46ecb75c4156e70c54bd6436'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798311,
'Height': 1824,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_driver-1774691106950.jpg',
'Width': 2432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1128108,
'Height': 2379,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_rear_driver-1774691162910.jpg',
'Width': 3172},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1015234,
'Height': 2024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7507/20237507/exterior_front_passenger-1774691129920.jpg',
'Width': 2698},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1020056,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7507/20237507/instrument_cluster-1774694618955.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddfc6a92-8aed-5735-b674-a974bbc41dd0/ddfc6a92-8aed-5735-b674-a974bbc41dd0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1648217,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/7507/20237507/20237507-interior_boot-default-1774695939721.jpg',
'Width': 4080}],
'price': 6395,
'price_includes_vat': False,
'registration_date': '2019-06-14',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Vivaro 3100 Elite S/S Auto',
'transmission': 'automatic',
'trim': '3100 Elite S/S Auto',
'vin': 'VXEVFEHZ8LZ001522',
'year': 2019}
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720237507%27 HTTP/1.1" 200 None
2026-03-29 20:18:01 [motorway.uk] INFO: Saving data for 20237507: {'created_time': 1774815481.029673, 'last_price_update_time': 1774815481.029684, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20237507') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item ddfc6a92-8aed-5735-b674-a974bbc41dd0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15e2d0>
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_rear_driver-1774519002085.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_driver-1774519002085.jpg saved to cache
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec66490>
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_front_passenger-1774519026497.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_passenger-1774519026497.jpg saved to cache
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca18510>
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_rear_passenger-1774519010868.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_passenger-1774519010868.jpg saved to cache
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20382041.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_driver-1774519015033.jpg> (referer: None)
2026-03-29 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7958/20437958/instrument_cluster-1774627821447.jpg> (referer: None)
2026-03-29 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7958/20437958/interior_boot-1774627802653.jpg> (referer: None)
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 with identifier: 20382041
2026-03-29 20:18:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 with scrape type 1
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_front_driver-1774692856945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_driver-1774692856945.jpg not downloaded yet
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_rear_driver-1774692843422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_rear_driver-1774692843422.jpg not downloaded yet
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_front_passenger-1774692876372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_passenger-1774692876372.jpg not downloaded yet
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec67210>
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6336%252F9706336%252Fexterior_front_driver-1774519015033.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_driver-1774519015033.jpg saved to cache
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f
2026-03-29 20:18:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8929d53c-a24f-5a84-b37a-f03edbc71b4f, skipping ID generation
2026-03-29 20:18:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f with scrape type 1
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8929d53c-a24f-5a84-b37a-f03edbc71b4f sending to next pipeline
2026-03-29 20:18:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8929d53c-a24f-5a84-b37a-f03edbc71b4f, identifier: 9706336
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca183d0>
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Finstrument_cluster-1774627821447.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/instrument_cluster-1774627821447.jpg saved to cache
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d26a890>
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7958%252F20437958%252Finterior_boot-1774627802653.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7958/20437958/interior_boot-1774627802653.jpg saved to cache
2026-03-29 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_rear_passenger-1774692835434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_rear_passenger-1774692835434.jpg not downloaded yet
2026-03-29 20:18:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8929d53c-a24f-5a84-b37a-f03edbc71b4f with identifier: 9706336
2026-03-29 20:18:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8929d53c-a24f-5a84-b37a-f03edbc71b4f with identifier: 9706336
2026-03-29 20:18:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8929d53c-a24f-5a84-b37a-f03edbc71b4f with identifier: 9706336 to the API
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_driver-1774519015033.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '6.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8929d53c-a24f-5a84-b37a-f03edbc71b4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RO55 SHX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9706336',
'listing': 'auction',
'location': 'Greater London Harrow',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 53227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1728568,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_driver-1774519015033.jpg',
'Width': 3483},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1186062,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_driver-1774519002085.jpg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1863612,
'Height': 2874,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_front_passenger-1774519026497.jpg',
'Width': 3832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1410409,
'Height': 2779,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6336/9706336/exterior_rear_passenger-1774519010868.jpg',
'Width': 3705},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2384272,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6336/9706336/interior_front_seats-1774519485544.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3363230,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6336/9706336/interior_rear_seats-1774519647681.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1514149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6336/9706336/interior_dashboard-1774519537486.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2182810,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6336/9706336/instrument_cluster-1774519574988.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929d53c-a24f-5a84-b37a-f03edbc71b4f/8929d53c-a24f-5a84-b37a-f03edbc71b4f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2996538,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6336/9706336/interior_boot-1774519544457.jpg',
'Width': 4032}],
'price': 22014,
'price_includes_vat': False,
'registration_date': '2014-11-06',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C63 AMG Auto',
'transmission': 'automatic',
'trim': 'C63 AMG Auto',
'vin': 'WDD2043772G380119',
'year': 2014}
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279706336%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [motorway.uk] INFO: Saving data for 9706336: {'created_time': 1774815482.378945, 'last_price_update_time': 1774815482.378955, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9706336') HTTP/1.1" 204 0
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2041%252F20382041%252Finterior_front_seats-1774693575590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2041/20382041/interior_front_seats-1774693575590.jpg not downloaded yet
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2041%252F20382041%252Finterior_rear_seats-1774693462855.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2041/20382041/interior_rear_seats-1774693462855.jpg not downloaded yet
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Finterior_dashboard-1774693542712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/interior_dashboard-1774693542712.jpg not downloaded yet
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Finstrument_cluster-1774693685077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/instrument_cluster-1774693685077.jpg not downloaded yet
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2041%252F20382041%252Finterior_boot-1774693613181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2041/20382041/interior_boot-1774693613181.jpg not downloaded yet
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2041%252F20382041%252Fdocs_service_history-1774695208054.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D32f7197c1e7ea49deef51db6e640c4e3%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2041/20382041/docs_service_history-1774695208054.jpg?ixlib=js-3.8.0&auto=format&s=32f7197c1e7ea49deef51db6e640c4e3 not downloaded yet
2026-03-29 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_passenger-1774608663563.jpg> (referer: None)
2026-03-29 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_passenger-1774608689333.jpg> (referer: None)
2026-03-29 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7958/20437958/interior_rear_seats-1774691352858.jpg> (referer: None)
2026-03-29 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20449935.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0b610>
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_rear_passenger-1774608663563.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_passenger-1774608663563.jpg saved to cache
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca83610>
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_front_passenger-1774608689333.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_passenger-1774608689333.jpg saved to cache
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16dfd0>
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7958%252F20437958%252Finterior_rear_seats-1774691352858.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7958/20437958/interior_rear_seats-1774691352858.jpg saved to cache
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b068e8-5543-551d-a65b-c62c82d5eaa5 with identifier: 20449935
2026-03-29 20:18:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 with scrape type 1
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Fexterior_front_driver-1774511395885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_driver-1774511395885.jpg not downloaded yet
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Fexterior_rear_driver-1774512165821.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_rear_driver-1774512165821.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Fexterior_front_passenger-1774511392396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_passenger-1774511392396.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9935%252F20449935%252Fexterior_rear_passenger-1774693114636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9935/20449935/exterior_rear_passenger-1774693114636.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9935%252F20449935%252Finterior_front_seats-1774511980450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9935/20449935/interior_front_seats-1774511980450.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9935%252F20449935%252Finterior_rear_seats-1774512007968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9935/20449935/interior_rear_seats-1774512007968.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9935%252F20449935%252Finterior_dashboard-1774693128948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9935/20449935/interior_dashboard-1774693128948.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Finstrument_cluster-1774511760409.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/instrument_cluster-1774511760409.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9935%252F20449935%252Finterior_boot-1774511688402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9935/20449935/interior_boot-1774511688402.jpg not downloaded yet
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9935%252F20449935%252Fdamage_scratches-1774629900134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9935/20449935/damage_scratches-1774629900134.jpg not downloaded yet
2026-03-29 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_driver-1774511395885.jpg> (referer: None)
2026-03-29 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_rear_passenger-1774692835434.jpg> (referer: None)
2026-03-29 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2041/20382041/interior_boot-1774693613181.jpg> (referer: None)
2026-03-29 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2041/20382041/instrument_cluster-1774693685077.jpg> (referer: None)
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec675d0>
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Fexterior_front_driver-1774511395885.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_driver-1774511395885.jpg saved to cache
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e7810>
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_rear_passenger-1774692835434.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_rear_passenger-1774692835434.jpg saved to cache
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca3d8d0>
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2041%252F20382041%252Finterior_boot-1774693613181.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2041/20382041/interior_boot-1774693613181.jpg saved to cache
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15e950>
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Finstrument_cluster-1774693685077.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/instrument_cluster-1774693685077.jpg saved to cache
2026-03-29 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9935/20449935/interior_boot-1774511688402.jpg> (referer: None)
2026-03-29 20:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_passenger-1774692876372.jpg> (referer: None)
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e00a450>
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9935%252F20449935%252Finterior_boot-1774511688402.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9935/20449935/interior_boot-1774511688402.jpg saved to cache
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14ee3090>
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_front_passenger-1774692876372.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_passenger-1774692876372.jpg saved to cache
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9935/20449935/instrument_cluster-1774511760409.jpg> (referer: None)
2026-03-29 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9935/20449935/interior_rear_seats-1774512007968.jpg> (referer: None)
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b4ad0>
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Finstrument_cluster-1774511760409.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/instrument_cluster-1774511760409.jpg saved to cache
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58cd10>
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9935%252F20449935%252Finterior_rear_seats-1774512007968.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9935/20449935/interior_rear_seats-1774512007968.jpg saved to cache
2026-03-29 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_rear_driver-1774512165821.jpg> (referer: None)
2026-03-29 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_passenger-1774511392396.jpg> (referer: None)
2026-03-29 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2041/20382041/interior_dashboard-1774693542712.jpg> (referer: None)
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d545390>
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Fexterior_rear_driver-1774512165821.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_rear_driver-1774512165821.jpg saved to cache
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58eb90>
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9935%252F20449935%252Fexterior_front_passenger-1774511392396.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_passenger-1774511392396.jpg saved to cache
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2b068e8-5543-551d-a65b-c62c82d5eaa5
2026-03-29 20:18:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2b068e8-5543-551d-a65b-c62c82d5eaa5, skipping ID generation
2026-03-29 20:18:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 with scrape type 1
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2b068e8-5543-551d-a65b-c62c82d5eaa5 sending to next pipeline
2026-03-29 20:18:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f2b068e8-5543-551d-a65b-c62c82d5eaa5, identifier: 20449935
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec64650>
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Finterior_dashboard-1774693542712.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/interior_dashboard-1774693542712.jpg saved to cache
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f2b068e8-5543-551d-a65b-c62c82d5eaa5 with identifier: 20449935
2026-03-29 20:18:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f2b068e8-5543-551d-a65b-c62c82d5eaa5 with identifier: 20449935
2026-03-29 20:18:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f2b068e8-5543-551d-a65b-c62c82d5eaa5 with identifier: 20449935 to the API
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_passenger-1774511392396.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f2b068e8-5543-551d-a65b-c62c82d5eaa5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW17 BND',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20449935',
'listing': 'auction',
'location': 'Hampshire Eastleigh',
'make': 'Jaguar',
'model': 'XE Series',
'odometer': 55557,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1365752,
'Height': 2552,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_driver-1774511395885.jpg',
'Width': 3402},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1254226,
'Height': 2314,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_rear_driver-1774512165821.jpg',
'Width': 3085},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1428209,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9935/20449935/exterior_front_passenger-1774511392396.jpg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4587829,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9935/20449935/interior_rear_seats-1774512007968.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3521591,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9935/20449935/instrument_cluster-1774511760409.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b068e8-5543-551d-a65b-c62c82d5eaa5/f2b068e8-5543-551d-a65b-c62c82d5eaa5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2823853,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9935/20449935/interior_boot-1774511688402.jpg',
'Width': 3840}],
'price': 12520,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE S V6 Auto',
'transmission': 'automatic',
'trim': 'XE S V6 Auto',
'vin': 'SAJAB4AV6JCP21148',
'year': 2017}
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720449935%27 HTTP/1.1" 200 None
2026-03-29 20:18:06 [motorway.uk] INFO: Saving data for 20449935: {'created_time': 1774815486.123505, 'last_price_update_time': 1774815486.123516, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20449935') HTTP/1.1" 204 0
2026-03-29 20:18:06 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 23 pages/min), scraped 62 items (at 15 items/min)
2026-03-29 20:18:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 253MiB
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_driver-1774692856945.jpg> (referer: None)
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2041/20382041/interior_rear_seats-1774693462855.jpg> (referer: None)
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2041/20382041/interior_front_seats-1774693575590.jpg> (referer: None)
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e00be10>
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2041%252F20382041%252Fexterior_front_driver-1774692856945.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_driver-1774692856945.jpg saved to cache
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14826836.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20000898.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b5450>
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2041%252F20382041%252Finterior_rear_seats-1774693462855.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2041/20382041/interior_rear_seats-1774693462855.jpg saved to cache
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d6290>
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2041%252F20382041%252Finterior_front_seats-1774693575590.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2041/20382041/interior_front_seats-1774693575590.jpg saved to cache
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6
2026-03-29 20:18:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6, skipping ID generation
2026-03-29 20:18:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 with scrape type 1
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 sending to next pipeline
2026-03-29 20:18:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6, identifier: 20382041
2026-03-29 20:18:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 with identifier: 20382041
2026-03-29 20:18:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 with identifier: 20382041
2026-03-29 20:18:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6 with identifier: 20382041 to the API
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2041/20382041/interior_front_seats-1774693575590.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MJ20 SSZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20382041',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'BMW',
'model': '2 Series',
'odometer': 54000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3036039,
'Height': 3020,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_driver-1774692856945.jpg',
'Width': 4027},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2610308,
'Height': 2992,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_front_passenger-1774692876372.jpg',
'Width': 3989},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465892,
'Height': 2969,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2041/20382041/exterior_rear_passenger-1774692835434.jpg',
'Width': 3958},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4451148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2041/20382041/interior_front_seats-1774693575590.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3714570,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2041/20382041/interior_rear_seats-1774693462855.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3364648,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2041/20382041/interior_dashboard-1774693542712.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2461247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2041/20382041/instrument_cluster-1774693685077.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6/b6fd1ffa-71c1-55dc-ac7a-53bde6fc00a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4512102,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2041/20382041/interior_boot-1774693613181.jpg',
'Width': 4032}],
'price': 11962,
'price_includes_vat': False,
'registration_date': '2020-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 218i M Sport Auto',
'transmission': 'automatic',
'trim': '218i M Sport Auto',
'vin': 'WBA6V720205R77867',
'year': 2020}
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382041%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [motorway.uk] INFO: Saving data for 20382041: {'created_time': 1774815487.235184, 'last_price_update_time': 1774815487.235195, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20382041') HTTP/1.1" 204 0
2026-03-29 20:18:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae2274a5-6726-5270-bc55-b08f0b7568e5 with identifier: 14826836
2026-03-29 20:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae2274a5-6726-5270-bc55-b08f0b7568e5 with scrape type 1
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_front_driver-1774784832380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_driver-1774784832380.jpg not downloaded yet
2026-03-29 20:18:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a251a4-0c06-5e31-b216-e20876e8c0be with identifier: 20000898
2026-03-29 20:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a251a4-0c06-5e31-b216-e20876e8c0be with scrape type 1
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18a251a4-0c06-5e31-b216-e20876e8c0be
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0898%252F20000898%252Fexterior_front_driver-1774631882523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0898/20000898/exterior_front_driver-1774631882523.jpg not downloaded yet
2026-03-29 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_driver-1774608604932.jpg> (referer: None)
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_rear_driver-1774784836722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_driver-1774784836722.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Fexterior_rear_driver-1774631331097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_driver-1774631331097.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_front_passenger-1774784832133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_passenger-1774784832133.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Fexterior_front_passenger-1774631375467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_front_passenger-1774631375467.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_rear_passenger-1774784827994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_passenger-1774784827994.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Fexterior_rear_passenger-1774631351684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_passenger-1774631351684.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Finterior_front_seats-1774786048429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/interior_front_seats-1774786048429.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0898%252F20000898%252Finterior_front_seats-1774631130739.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0898/20000898/interior_front_seats-1774631130739.jpg not downloaded yet
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbeaa10>
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_front_driver-1774608604932.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_driver-1774608604932.jpg saved to cache
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Finterior_rear_seats-1774786042339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/interior_rear_seats-1774786042339.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0898%252F20000898%252Finterior_rear_seats-1774631122138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0898/20000898/interior_rear_seats-1774631122138.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Finterior_dashboard-1774786063807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/interior_dashboard-1774786063807.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Finterior_dashboard-1774631140602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/interior_dashboard-1774631140602.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Finterior_boot-1774786045785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/interior_boot-1774786045785.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Finstrument_cluster-1774631141348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/instrument_cluster-1774631141348.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6836%252F14826836%252Fdocs_service_history-1774787610594.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D62eb947f1f3f85b72593bee8b8a1a1d7%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6836/14826836/docs_service_history-1774787610594.jpg?ixlib=js-3.8.0&auto=format&s=62eb947f1f3f85b72593bee8b8a1a1d7 not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0898%252F20000898%252Finterior_boot-1774631871428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0898/20000898/interior_boot-1774631871428.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Fdamage_scratches-1774785028998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/damage_scratches-1774785028998.jpg not downloaded yet
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0898%252F20000898%252Fdocs_service_history-1774631430329.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c45b388e679c1ba98c8af93cc94052a%27 HTTP/1.1" 200 None
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0898/20000898/docs_service_history-1774631430329.jpg?ixlib=js-3.8.0&auto=format&s=8c45b388e679c1ba98c8af93cc94052a not downloaded yet
2026-03-29 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_driver-1774608646191.jpg> (referer: None)
2026-03-29 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_driver-1774704559017.jpg> (referer: None)
2026-03-29 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4074/20254074/exterior_rear_driver-1774704817015.jpg> (referer: None)
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9f210>
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7958%252F20437958%252Fexterior_rear_driver-1774608646191.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_driver-1774608646191.jpg saved to cache
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57b0a60b-1521-5738-864e-d4c0e3e0a215
2026-03-29 20:18:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57b0a60b-1521-5738-864e-d4c0e3e0a215, skipping ID generation
2026-03-29 20:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b0a60b-1521-5738-864e-d4c0e3e0a215 with scrape type 1
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57b0a60b-1521-5738-864e-d4c0e3e0a215 sending to next pipeline
2026-03-29 20:18:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 57b0a60b-1521-5738-864e-d4c0e3e0a215, identifier: 20437958
2026-03-29 20:18:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 57b0a60b-1521-5738-864e-d4c0e3e0a215 with identifier: 20437958
2026-03-29 20:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 57b0a60b-1521-5738-864e-d4c0e3e0a215 with identifier: 20437958
2026-03-29 20:18:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 57b0a60b-1521-5738-864e-d4c0e3e0a215 with identifier: 20437958 to the API
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_driver-1774608646191.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '57b0a60b-1521-5738-864e-d4c0e3e0a215',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FH21 UCT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20437958',
'listing': 'auction',
'location': 'Greater London Carshalton',
'make': 'Mercedes',
'model': 'GLE Class',
'odometer': 26500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1722044,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_driver-1774608604932.jpg',
'Width': 3310},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1782298,
'Height': 2633,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_driver-1774608646191.jpg',
'Width': 3511},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616234,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_front_passenger-1774608689333.jpg',
'Width': 3291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1492739,
'Height': 2412,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7958/20437958/exterior_rear_passenger-1774608663563.jpg',
'Width': 3216},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2953357,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7958/20437958/interior_rear_seats-1774691352858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2874510,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7958/20437958/instrument_cluster-1774627821447.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57b0a60b-1521-5738-864e-d4c0e3e0a215/57b0a60b-1521-5738-864e-d4c0e3e0a215_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3913539,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7958/20437958/interior_boot-1774627802653.jpg',
'Width': 4032}],
'price': 37293,
'price_includes_vat': False,
'registration_date': '2021-06-20',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLE 350 AMG Line Prem D 4M A',
'transmission': 'automatic',
'trim': 'GLE 350 AMG Line Prem D 4M A',
'vin': 'WDC1671212A118537',
'year': 2021}
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720437958%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [motorway.uk] INFO: Saving data for 20437958: {'created_time': 1774815488.475991, 'last_price_update_time': 1774815488.476001, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20437958') HTTP/1.1" 204 0
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d798090>
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4074%252F20254074%252Fexterior_front_driver-1774704559017.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_driver-1774704559017.jpg saved to cache
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec3bb90>
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4074%252F20254074%252Fexterior_rear_driver-1774704817015.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4074/20254074/exterior_rear_driver-1774704817015.jpg saved to cache
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b
2026-03-29 20:18:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c729af4c-68c4-5ee4-b1f8-6bcf083faa1b, skipping ID generation
2026-03-29 20:18:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b with scrape type 1
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c729af4c-68c4-5ee4-b1f8-6bcf083faa1b sending to next pipeline
2026-03-29 20:18:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c729af4c-68c4-5ee4-b1f8-6bcf083faa1b, identifier: 20254074
2026-03-29 20:18:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c729af4c-68c4-5ee4-b1f8-6bcf083faa1b with identifier: 20254074
2026-03-29 20:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c729af4c-68c4-5ee4-b1f8-6bcf083faa1b with identifier: 20254074
2026-03-29 20:18:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c729af4c-68c4-5ee4-b1f8-6bcf083faa1b with identifier: 20254074 to the API
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4074/20254074/exterior_rear_driver-1774704817015.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c729af4c-68c4-5ee4-b1f8-6bcf083faa1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ21 BKG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20254074',
'listing': 'auction',
'location': 'Staffordshire Lichfield',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 16000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1037664,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_driver-1774704559017.jpg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3023482,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4074/20254074/exterior_rear_driver-1774704817015.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1749393,
'Height': 2874,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_front_passenger-1774703567690.jpg',
'Width': 3832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1151525,
'Height': 2849,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4074/20254074/exterior_rear_passenger-1774704514255.jpg',
'Width': 3799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3940207,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4074/20254074/interior_front_seats-1774703648114.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5760297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4074/20254074/interior_rear_seats-1774704759068.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3645061,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4074/20254074/interior_dashboard-1774703833735.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3581762,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4074/20254074/instrument_cluster-1774008077539.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729af4c-68c4-5ee4-b1f8-6bcf083faa1b/c729af4c-68c4-5ee4-b1f8-6bcf083faa1b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2828104,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4074/20254074/interior_boot-1774703841016.jpg',
'Width': 4032}],
'price': 49850,
'price_includes_vat': False,
'registration_date': '2021-04-06',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot Boxer',
'transmission': 'manual',
'trim': '',
'vin': 'VF3YCCNAU12N64732',
'year': 2021}
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254074%27 HTTP/1.1" 200 None
2026-03-29 20:18:09 [motorway.uk] INFO: Saving data for 20254074: {'created_time': 1774815489.794911, 'last_price_update_time': 1774815489.794928, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20254074') HTTP/1.1" 204 0
2026-03-29 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20476001.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 18a251a4-0c06-5e31-b216-e20876e8c0be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 18a251a4-0c06-5e31-b216-e20876e8c0be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 255b9417-33bc-581e-88dc-7e3d8070711f with identifier: 20476001
2026-03-29 20:18:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255b9417-33bc-581e-88dc-7e3d8070711f with scrape type 1
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 255b9417-33bc-581e-88dc-7e3d8070711f
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fexterior_front_driver-1774717745697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_driver-1774717745697.jpg not downloaded yet
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fexterior_rear_driver-1774717774822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_rear_driver-1774717774822.jpg not downloaded yet
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fexterior_front_passenger-1774717840065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_passenger-1774717840065.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6001%252F20476001%252Fexterior_rear_passenger-1774776049341.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6001/20476001/exterior_rear_passenger-1774776049341.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6001%252F20476001%252Finterior_front_seats-1774718470833.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6001/20476001/interior_front_seats-1774718470833.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6001%252F20476001%252Finterior_rear_seats-1774718489448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6001/20476001/interior_rear_seats-1774718489448.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6001%252F20476001%252Finterior_dashboard-1774775349038.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6001/20476001/interior_dashboard-1774775349038.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6001%252F20476001%252Finterior_boot-1774718565521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6001/20476001/interior_boot-1774718565521.jpg not downloaded yet
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12887188.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19693972.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fwheels_front_driver-1774717948230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_front_driver-1774717948230.jpg not downloaded yet
2026-03-29 20:18:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fwheels_rear_driver-1774717959500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_rear_driver-1774717959500.jpg not downloaded yet
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6836/14826836/damage_scratches-1774785028998.jpg> (referer: None)
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6836/14826836/interior_boot-1774786045785.jpg> (referer: None)
2026-03-29 20:18:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b99589-122a-53f3-83aa-e72ee286175f with identifier: 12887188
2026-03-29 20:18:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b99589-122a-53f3-83aa-e72ee286175f with scrape type 1
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Fexterior_front_driver-1774701013543.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_front_driver-1774701013543.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Fexterior_rear_driver-1774700868320.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_rear_driver-1774700868320.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Fexterior_front_passenger-1774700937990.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_front_passenger-1774700937990.jpeg not downloaded yet
2026-03-29 20:18:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06985444-ad9d-5cad-bc05-ed0f3f8d026f with identifier: 19693972
2026-03-29 20:18:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f with scrape type 1
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_front_driver-1774702932870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_driver-1774702932870.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Fexterior_rear_passenger-1774700966966.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_rear_passenger-1774700966966.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_rear_driver-1774703219137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_driver-1774703219137.jpg not downloaded yet
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d9310>
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Fdamage_scratches-1774785028998.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/damage_scratches-1774785028998.jpg saved to cache
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c256ed0>
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Finterior_boot-1774786045785.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/interior_boot-1774786045785.jpg saved to cache
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7188%252F12887188%252Finterior_front_seats-1774701080096.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7188/12887188/interior_front_seats-1774701080096.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_front_passenger-1774703164878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_passenger-1774703164878.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7188%252F12887188%252Finterior_rear_seats-1774701121767.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7188/12887188/interior_rear_seats-1774701121767.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_rear_passenger-1774703475089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_passenger-1774703475089.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Finterior_dashboard-1774701152052.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/interior_dashboard-1774701152052.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3972%252F19693972%252F19693972-interior_front_seats-1774702654314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3972/19693972/19693972-interior_front_seats-1774702654314.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Finstrument_cluster-1774701227007.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/instrument_cluster-1774701227007.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3972%252F19693972%252Finterior_rear_seats-1774716815556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3972/19693972/interior_rear_seats-1774716815556.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7188%252F12887188%252Finterior_boot-1774701170611.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7188/12887188/interior_boot-1774701170611.jpeg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-interior_dashboard-1774702637696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-interior_dashboard-1774702637696.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7188%252F12887188%252Fdocs_service_history-1774551664391.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df40a55673c33f3b52b7db7ad92097ece%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7188/12887188/docs_service_history-1774551664391.jpeg?ixlib=js-3.8.0&auto=format&s=f40a55673c33f3b52b7db7ad92097ece not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3972%252F19693972%252F19693972-interior_boot-1774702553946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3972/19693972/19693972-interior_boot-1774702553946.jpg not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3972%252F19693972%252Fdocs_service_history-1774715264685.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D76c93897a80d496b20b80417756dd98d%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3972/19693972/docs_service_history-1774715264685.jpg?ixlib=js-3.8.0&auto=format&s=76c93897a80d496b20b80417756dd98d not downloaded yet
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3972%252F19693972%252Fdamage_paintwork-1774708456876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3972/19693972/damage_paintwork-1774708456876.jpg not downloaded yet
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0898/20000898/instrument_cluster-1774631141348.jpg> (referer: None)
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_front_driver-1774717948230.jpg> (referer: None)
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item ae2274a5-6726-5270-bc55-b08f0b7568e5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d014f10>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Finstrument_cluster-1774631141348.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/instrument_cluster-1774631141348.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18a251a4-0c06-5e31-b216-e20876e8c0be
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb02510>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fwheels_front_driver-1774717948230.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_front_driver-1774717948230.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 255b9417-33bc-581e-88dc-7e3d8070711f
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 255b9417-33bc-581e-88dc-7e3d8070711f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 255b9417-33bc-581e-88dc-7e3d8070711f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-interior_dashboard-1774702637696.jpg> (referer: None)
2026-03-29 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7188/12887188/interior_front_seats-1774701080096.jpeg> (referer: None)
2026-03-29 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3972/19693972/19693972-interior_boot-1774702553946.jpg> (referer: None)
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16d250>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-interior_dashboard-1774702637696.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-interior_dashboard-1774702637696.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone SE (2nd generation)\x00'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 196 - value: b'26.3.1\x00'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 204 - value: b'2026:03:28 12:31:15\x00'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 224 - value: b'iPhone SE (2nd generation)\x00'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xfc'
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7c1e10>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7188%252F12887188%252Finterior_front_seats-1774701080096.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7188/12887188/interior_front_seats-1774701080096.jpeg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07ecd0>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3972%252F19693972%252F19693972-interior_boot-1774702553946.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3972/19693972/19693972-interior_boot-1774702553946.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3972/19693972/19693972-interior_front_seats-1774702654314.jpg> (referer: None)
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7188/12887188/instrument_cluster-1774701227007.jpeg> (referer: None)
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b4b10>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3972%252F19693972%252F19693972-interior_front_seats-1774702654314.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3972/19693972/19693972-interior_front_seats-1774702654314.jpg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone SE (2nd generation)\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 196 - value: b'26.3.1\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 204 - value: b'2026:03:28 12:31:31\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 224 - value: b'iPhone SE (2nd generation)\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xfc'
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07e650>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Finstrument_cluster-1774701227007.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/instrument_cluster-1774701227007.jpeg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_passenger-1774703475089.jpg> (referer: None)
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7188/12887188/interior_dashboard-1774701152052.jpeg> (referer: None)
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7188/12887188/interior_rear_seats-1774701121767.jpeg> (referer: None)
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_driver-1774702932870.jpg> (referer: None)
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 61b99589-122a-53f3-83aa-e72ee286175f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 61b99589-122a-53f3-83aa-e72ee286175f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c240f10>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_rear_passenger-1774703475089.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_passenger-1774703475089.jpg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec65210>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Finterior_dashboard-1774701152052.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/interior_dashboard-1774701152052.jpeg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone SE (2nd generation)\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 196 - value: b'26.3.1\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 204 - value: b'2026:03:28 12:31:56\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 224 - value: b'iPhone SE (2nd generation)\x00'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xfc'
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c211490>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7188%252F12887188%252Finterior_rear_seats-1774701121767.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7188/12887188/interior_rear_seats-1774701121767.jpeg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb00cd0>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_front_driver-1774702932870.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_driver-1774702932870.jpg saved to cache
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20080388.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_passenger-1774703164878.jpg> (referer: None)
2026-03-29 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_driver-1774703219137.jpg> (referer: None)
2026-03-29 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_front_passenger-1774700937990.jpeg> (referer: None)
2026-03-29 20:18:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a with identifier: 20080388
2026-03-29 20:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a with scrape type 1
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_front_driver-1774705096671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_driver-1774705096671.jpg not downloaded yet
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_rear_driver-1774705101112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_driver-1774705101112.jpg not downloaded yet
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_front_passenger-1774705098462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_passenger-1774705098462.jpg not downloaded yet
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecf950>
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_front_passenger-1774703164878.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_passenger-1774703164878.jpg saved to cache
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d790690>
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3972%252F19693972%252F19693972-exterior_rear_driver-1774703219137.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_driver-1774703219137.jpg saved to cache
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f
2026-03-29 20:18:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06985444-ad9d-5cad-bc05-ed0f3f8d026f, skipping ID generation
2026-03-29 20:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f with scrape type 1
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06985444-ad9d-5cad-bc05-ed0f3f8d026f sending to next pipeline
2026-03-29 20:18:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 06985444-ad9d-5cad-bc05-ed0f3f8d026f, identifier: 19693972
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d78bd10>
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Fexterior_front_passenger-1774700937990.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_front_passenger-1774700937990.jpeg saved to cache
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_rear_passenger-1774705097700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_passenger-1774705097700.jpg not downloaded yet
2026-03-29 20:18:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 06985444-ad9d-5cad-bc05-ed0f3f8d026f with identifier: 19693972
2026-03-29 20:18:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 06985444-ad9d-5cad-bc05-ed0f3f8d026f with identifier: 19693972
2026-03-29 20:18:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 06985444-ad9d-5cad-bc05-ed0f3f8d026f with identifier: 19693972 to the API
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_driver-1774703219137.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '06985444-ad9d-5cad-bc05-ed0f3f8d026f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GY65 UHR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19693972',
'listing': 'auction',
'location': 'Wiltshire Salisbury',
'make': 'MINI',
'model': 'One',
'odometer': 55000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639913,
'Height': 1758,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_driver-1774702932870.jpg',
'Width': 2344},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619562,
'Height': 1850,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_driver-1774703219137.jpg',
'Width': 2466},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560228,
'Height': 1850,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_front_passenger-1774703164878.jpg',
'Width': 2467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909000,
'Height': 2105,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-exterior_rear_passenger-1774703475089.jpg',
'Width': 2806},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1232858,
'Height': 2160,
'OriginUrl': 'https://motorway-photos.imgix.net/3972/19693972/19693972-interior_front_seats-1774702654314.jpg',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1417439,
'Height': 2160,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3972/19693972/19693972-interior_dashboard-1774702637696.jpg',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06985444-ad9d-5cad-bc05-ed0f3f8d026f/06985444-ad9d-5cad-bc05-ed0f3f8d026f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1177726,
'Height': 2160,
'OriginUrl': 'https://motorway-photos.imgix.net/3972/19693972/19693972-interior_boot-1774702553946.jpg',
'Width': 2880}],
'price': 7016,
'price_includes_vat': False,
'registration_date': '2016-01-15',
'seats_number': None,
'seller_name': None,
'title': 'MINI One Auto',
'transmission': 'automatic',
'trim': 'Auto',
'vin': 'WMWXS120102C74629',
'year': 2016}
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719693972%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [motorway.uk] INFO: Saving data for 19693972: {'created_time': 1774815494.115193, 'last_price_update_time': 1774815494.115203, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19693972') HTTP/1.1" 204 0
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0388%252F20080388%252Finterior_front_seats-1774705380498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0388/20080388/interior_front_seats-1774705380498.jpg not downloaded yet
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0388%252F20080388%252Finterior_rear_seats-1774705382662.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0388/20080388/interior_rear_seats-1774705382662.jpg not downloaded yet
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Finterior_dashboard-1774705386987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/interior_dashboard-1774705386987.jpg not downloaded yet
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Finstrument_cluster-1774705426489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/instrument_cluster-1774705426489.jpg not downloaded yet
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0388%252F20080388%252Finterior_boot-1774707637391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0388/20080388/interior_boot-1774707637391.jpg not downloaded yet
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 61b99589-122a-53f3-83aa-e72ee286175f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 61b99589-122a-53f3-83aa-e72ee286175f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 255b9417-33bc-581e-88dc-7e3d8070711f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 255b9417-33bc-581e-88dc-7e3d8070711f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0388%252F20080388%252Fdocs_service_history-1774707621856.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74db3556834c555a40159d468acdfc5c%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0388/20080388/docs_service_history-1774707621856.jpg?ixlib=js-3.8.0&auto=format&s=74db3556834c555a40159d468acdfc5c not downloaded yet
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_rear_driver-1774700868320.jpeg> (referer: None)
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6001/20476001/interior_rear_seats-1774718489448.jpg> (referer: None)
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6001/20476001/interior_front_seats-1774718470833.jpg> (referer: None)
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_passenger-1774705098462.jpg> (referer: None)
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd7090>
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7188%252F12887188%252Fexterior_rear_driver-1774700868320.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_rear_driver-1774700868320.jpeg saved to cache
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61b99589-122a-53f3-83aa-e72ee286175f
2026-03-29 20:18:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61b99589-122a-53f3-83aa-e72ee286175f, skipping ID generation
2026-03-29 20:18:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b99589-122a-53f3-83aa-e72ee286175f with scrape type 1
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61b99589-122a-53f3-83aa-e72ee286175f sending to next pipeline
2026-03-29 20:18:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 61b99589-122a-53f3-83aa-e72ee286175f, identifier: 12887188
2026-03-29 20:18:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 61b99589-122a-53f3-83aa-e72ee286175f with identifier: 12887188
2026-03-29 20:18:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 61b99589-122a-53f3-83aa-e72ee286175f with identifier: 12887188
2026-03-29 20:18:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 61b99589-122a-53f3-83aa-e72ee286175f with identifier: 12887188 to the API
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_rear_driver-1774700868320.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '61b99589-122a-53f3-83aa-e72ee286175f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KM20 NFO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12887188',
'listing': 'auction',
'location': 'Lincolnshire Mablethorpe',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 36374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2068913,
'Height': 2924,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_rear_driver-1774700868320.jpeg',
'Width': 3899},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1557953,
'Height': 2647,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7188/12887188/exterior_front_passenger-1774700937990.jpeg',
'Width': 3529},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2841898,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7188/12887188/interior_front_seats-1774701080096.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3349174,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7188/12887188/interior_rear_seats-1774701121767.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1280099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7188/12887188/interior_dashboard-1774701152052.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b99589-122a-53f3-83aa-e72ee286175f/61b99589-122a-53f3-83aa-e72ee286175f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673963,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7188/12887188/instrument_cluster-1774701227007.jpeg',
'Width': 4032}],
'price': 21026,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport R-DYNAMIC HSE D A',
'transmission': 'automatic',
'trim': 'Sport R-DYNAMIC HSE D A',
'vin': 'SALCA2AN8LH865510',
'year': 2020}
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712887188%27 HTTP/1.1" 200 None
2026-03-29 20:18:14 [motorway.uk] INFO: Saving data for 12887188: {'created_time': 1774815494.990769, 'last_price_update_time': 1774815494.990779, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12887188') HTTP/1.1" 204 0
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fe950>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6001%252F20476001%252Finterior_rear_seats-1774718489448.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6001/20476001/interior_rear_seats-1774718489448.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 255b9417-33bc-581e-88dc-7e3d8070711f
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdd850>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6001%252F20476001%252Finterior_front_seats-1774718470833.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6001/20476001/interior_front_seats-1774718470833.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 255b9417-33bc-581e-88dc-7e3d8070711f
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2b8e90>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_front_passenger-1774705098462.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_passenger-1774705098462.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_driver-1774705101112.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_passenger-1774705097700.jpg> (referer: None)
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e92af90>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_rear_driver-1774705101112.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_driver-1774705101112.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021790>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Fexterior_rear_passenger-1774705097700.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_passenger-1774705097700.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0388/20080388/interior_rear_seats-1774705382662.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0388/20080388/interior_front_seats-1774705380498.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0388/20080388/interior_dashboard-1774705386987.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_rear_driver-1774717774822.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0388/20080388/instrument_cluster-1774705426489.jpg> (referer: None)
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2b9190>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0388%252F20080388%252Finterior_rear_seats-1774705382662.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0388/20080388/interior_rear_seats-1774705382662.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d507f90>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0388%252F20080388%252Finterior_front_seats-1774705380498.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0388/20080388/interior_front_seats-1774705380498.jpg saved to cache
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae7b10>
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Finterior_dashboard-1774705386987.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/interior_dashboard-1774705386987.jpg saved to cache
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1d7bd0>
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fexterior_rear_driver-1774717774822.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_rear_driver-1774717774822.jpg saved to cache
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 255b9417-33bc-581e-88dc-7e3d8070711f
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea46c50>
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0388%252F20080388%252Finstrument_cluster-1774705426489.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0388/20080388/instrument_cluster-1774705426489.jpg saved to cache
2026-03-29 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a
2026-03-29 20:18:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_passenger-1774717840065.jpg> (referer: None)
2026-03-29 20:18:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a with identifier: 20080388
2026-03-29 20:18:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a with identifier: 20080388
2026-03-29 20:18:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a with identifier: 20080388 to the API
2026-03-29 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:17 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7abb0346-ac18-57e6-ba7e-e2d2eb2a785a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y14 JOD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20080388',
'listing': 'auction',
'location': 'None None',
'make': 'Audi',
'model': 'Q5',
'odometer': 12041,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_driver-1774705096671.jpg',
'https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_driver-1774705101112.jpg',
'https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_passenger-1774705098462.jpg',
'https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_passenger-1774705097700.jpg',
'https://motorway-photos.imgix.net/0388/20080388/interior_front_seats-1774705380498.jpg',
'https://motorway-photos.imgix.net/0388/20080388/interior_rear_seats-1774705382662.jpg',
'https://motorway-photos-redacted.imgix.net/0388/20080388/interior_dashboard-1774705386987.jpg',
'https://motorway-photos-redacted.imgix.net/0388/20080388/instrument_cluster-1774705426489.jpg',
'https://motorway-photos-modified.imgix.net/0388/20080388/interior_boot-1774707637391.jpg',
'https://motorway-service-history-photos.imgix.net/modified/0388/20080388/docs_service_history-1774707621856.jpg?ixlib=js-3.8.0&auto=format&s=74db3556834c555a40159d468acdfc5c'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1177426,
'Height': 2204,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_driver-1774705101112.jpg',
'Width': 2938},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1065072,
'Height': 2339,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_front_passenger-1774705098462.jpg',
'Width': 3119},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1620054,
'Height': 2558,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0388/20080388/exterior_rear_passenger-1774705097700.jpg',
'Width': 3411},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2068401,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0388/20080388/interior_front_seats-1774705380498.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1847893,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0388/20080388/interior_rear_seats-1774705382662.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1599171,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0388/20080388/interior_dashboard-1774705386987.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7abb0346-ac18-57e6-ba7e-e2d2eb2a785a/7abb0346-ac18-57e6-ba7e-e2d2eb2a785a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1704755,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0388/20080388/instrument_cluster-1774705426489.jpg',
'Width': 3840}],
'price': 37842,
'price_includes_vat': False,
'registration_date': '2024-09-13',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q5 SLN BLK ED 45TFSI MHEV Q SA',
'transmission': 'automatic',
'trim': 'SLN BLK ED 45TFSI MHEV Q SA',
'vin': 'WAUZZZFY7R2135814',
'year': 2024}
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720080388%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [motorway.uk] INFO: Saving data for 20080388: {'created_time': 1774815497.193044, 'last_price_update_time': 1774815497.193055, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20080388') HTTP/1.1" 204 0
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7abb0346-ac18-57e6-ba7e-e2d2eb2a785a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1d6a50>
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6001%252F20476001%252Fexterior_front_passenger-1774717840065.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_passenger-1774717840065.jpg saved to cache
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 255b9417-33bc-581e-88dc-7e3d8070711f
2026-03-29 20:18:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 255b9417-33bc-581e-88dc-7e3d8070711f with identifier: 20476001
2026-03-29 20:18:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 255b9417-33bc-581e-88dc-7e3d8070711f with identifier: 20476001
2026-03-29 20:18:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 255b9417-33bc-581e-88dc-7e3d8070711f with identifier: 20476001 to the API
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:17 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '255b9417-33bc-581e-88dc-7e3d8070711f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY25 ZZU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20476001',
'listing': 'auction',
'location': 'Buckinghamshire Chesham',
'make': 'Mercedes',
'model': 'GLC',
'odometer': 9015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_driver-1774717745697.jpg',
'https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_rear_driver-1774717774822.jpg',
'https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_passenger-1774717840065.jpg',
'https://motorway-photos-modified.imgix.net/6001/20476001/exterior_rear_passenger-1774776049341.jpg',
'https://motorway-photos.imgix.net/6001/20476001/interior_front_seats-1774718470833.jpg',
'https://motorway-photos.imgix.net/6001/20476001/interior_rear_seats-1774718489448.jpg',
'https://motorway-photos-modified.imgix.net/6001/20476001/interior_dashboard-1774775349038.jpg',
'https://motorway-photos.imgix.net/6001/20476001/interior_boot-1774718565521.jpg',
'https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_front_driver-1774717948230.jpg',
'https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_rear_driver-1774717959500.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893921,
'Height': 2665,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_rear_driver-1774717774822.jpg',
'Width': 3553},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1814545,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6001/20476001/exterior_front_passenger-1774717840065.jpg',
'Width': 3478},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3666444,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6001/20476001/interior_front_seats-1774718470833.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3426740,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6001/20476001/interior_rear_seats-1774718489448.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255b9417-33bc-581e-88dc-7e3d8070711f/255b9417-33bc-581e-88dc-7e3d8070711f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1926370,
'Height': 2812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6001/20476001/wheels_front_driver-1774717948230.jpg',
'Width': 3749}],
'price': 48117,
'price_includes_vat': False,
'registration_date': '2025-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLC 300 AMG LN PREM+ MHEV 4M A',
'transmission': 'automatic',
'trim': '300 AMG LN PREM+ MHEV 4M A',
'vin': 'W1NKM4HB8SF342587',
'year': 2025}
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476001%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [motorway.uk] INFO: Saving data for 20476001: {'created_time': 1774815497.686516, 'last_price_update_time': 1774815497.686526, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20476001') HTTP/1.1" 204 0
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 18a251a4-0c06-5e31-b216-e20876e8c0be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6836/14826836/interior_rear_seats-1774786042339.jpg> (referer: None)
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 255b9417-33bc-581e-88dc-7e3d8070711f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6836/14826836/interior_dashboard-1774786063807.jpg> (referer: None)
2026-03-29 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_passenger-1774631351684.jpg> (referer: None)
2026-03-29 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0898/20000898/interior_rear_seats-1774631122138.jpg> (referer: None)
2026-03-29 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_passenger-1774784827994.jpg> (referer: None)
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 18a251a4-0c06-5e31-b216-e20876e8c0be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item ae2274a5-6726-5270-bc55-b08f0b7568e5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea86550>
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6836%252F14826836%252Finterior_rear_seats-1774786042339.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6836/14826836/interior_rear_seats-1774786042339.jpg saved to cache
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea85650>
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Finterior_dashboard-1774786063807.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/interior_dashboard-1774786063807.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d211790>
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Fexterior_rear_passenger-1774631351684.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_passenger-1774631351684.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18a251a4-0c06-5e31-b216-e20876e8c0be
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d022910>
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0898%252F20000898%252Finterior_rear_seats-1774631122138.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0898/20000898/interior_rear_seats-1774631122138.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18a251a4-0c06-5e31-b216-e20876e8c0be
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef6e90>
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_rear_passenger-1774784827994.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_passenger-1774784827994.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_front_passenger-1774631375467.jpg> (referer: None)
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2ad690>
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0898%252F20000898%252Fexterior_front_passenger-1774631375467.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_front_passenger-1774631375467.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18a251a4-0c06-5e31-b216-e20876e8c0be
2026-03-29 20:18:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_driver-1774784832380.jpg> (referer: None)
2026-03-29 20:18:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_driver-1774784836722.jpg> (referer: None)
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d507390>
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_front_driver-1774784832380.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_driver-1774784832380.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd62d0>
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6836%252F14826836%252Fexterior_rear_driver-1774784836722.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_driver-1774784836722.jpg saved to cache
2026-03-29 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae2274a5-6726-5270-bc55-b08f0b7568e5
2026-03-29 20:18:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ae2274a5-6726-5270-bc55-b08f0b7568e5 with identifier: 14826836
2026-03-29 20:18:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ae2274a5-6726-5270-bc55-b08f0b7568e5 with identifier: 14826836
2026-03-29 20:18:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ae2274a5-6726-5270-bc55-b08f0b7568e5 with identifier: 14826836 to the API
2026-03-29 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ae2274a5-6726-5270-bc55-b08f0b7568e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WK13 FER',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14826836',
'listing': 'auction',
'location': 'City of Bristol Bristol',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 12398,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_driver-1774784832380.jpg',
'https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_driver-1774784836722.jpg',
'https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_passenger-1774784832133.jpg',
'https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_passenger-1774784827994.jpg',
'https://motorway-photos.imgix.net/6836/14826836/interior_front_seats-1774786048429.jpg',
'https://motorway-photos.imgix.net/6836/14826836/interior_rear_seats-1774786042339.jpg',
'https://motorway-photos-redacted.imgix.net/6836/14826836/interior_dashboard-1774786063807.jpg',
'https://motorway-photos.imgix.net/6836/14826836/interior_boot-1774786045785.jpg',
'https://motorway-service-history-photos.imgix.net/modified/6836/14826836/docs_service_history-1774787610594.jpg?ixlib=js-3.8.0&auto=format&s=62eb947f1f3f85b72593bee8b8a1a1d7',
'https://motorway-photos.imgix.net/6836/14826836/damage_scratches-1774785028998.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1065156,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_front_driver-1774784832380.jpg',
'Width': 3302},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1298333,
'Height': 2389,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_driver-1774784836722.jpg',
'Width': 3185},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1691114,
'Height': 2406,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6836/14826836/exterior_rear_passenger-1774784827994.jpg',
'Width': 3208},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742782,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6836/14826836/interior_rear_seats-1774786042339.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1533242,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6836/14826836/interior_dashboard-1774786063807.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2633344,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6836/14826836/interior_boot-1774786045785.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae2274a5-6726-5270-bc55-b08f0b7568e5/ae2274a5-6726-5270-bc55-b08f0b7568e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1613795,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6836/14826836/damage_scratches-1774785028998.jpg',
'Width': 3840}],
'price': 21002,
'price_includes_vat': False,
'registration_date': '2021-07-30',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport Rdyn S+ MHEV A',
'transmission': 'automatic',
'trim': 'Sport Rdyn S+ MHEV A',
'vin': 'SALCA2AX6MH900242',
'year': 2021}
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714826836%27 HTTP/1.1" 200 None
2026-03-29 20:18:19 [motorway.uk] INFO: Saving data for 14826836: {'created_time': 1774815499.269308, 'last_price_update_time': 1774815499.269323, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14826836') HTTP/1.1" 204 0
2026-03-29 20:18:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item ae2274a5-6726-5270-bc55-b08f0b7568e5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 18a251a4-0c06-5e31-b216-e20876e8c0be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7094/20457094/instrument_cluster-1774701135280.jpg> (referer: None)
2026-03-29 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7094/20457094/interior_dashboard-1774701301479.jpg> (referer: None)
2026-03-29 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7094/20457094/interior_boot-1774701308447.jpg> (referer: None)
2026-03-29 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7094/20457094/interior_rear_seats-1774701808994.jpg> (referer: None)
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21dd50>
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Finstrument_cluster-1774701135280.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/instrument_cluster-1774701135280.jpg saved to cache
2026-03-29 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 18a251a4-0c06-5e31-b216-e20876e8c0be with identifier: 20000898
2026-03-29 20:18:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 18a251a4-0c06-5e31-b216-e20876e8c0be with identifier: 20000898
2026-03-29 20:18:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 18a251a4-0c06-5e31-b216-e20876e8c0be with identifier: 20000898 to the API
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '18a251a4-0c06-5e31-b216-e20876e8c0be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WR20 SKZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20000898',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://motorway-photos-modified.imgix.net/0898/20000898/exterior_front_driver-1774631882523.jpg',
'https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_driver-1774631331097.jpg',
'https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_front_passenger-1774631375467.jpg',
'https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_passenger-1774631351684.jpg',
'https://motorway-photos.imgix.net/0898/20000898/interior_front_seats-1774631130739.jpg',
'https://motorway-photos.imgix.net/0898/20000898/interior_rear_seats-1774631122138.jpg',
'https://motorway-photos-redacted.imgix.net/0898/20000898/interior_dashboard-1774631140602.jpg',
'https://motorway-photos-redacted.imgix.net/0898/20000898/instrument_cluster-1774631141348.jpg',
'https://motorway-photos-modified.imgix.net/0898/20000898/interior_boot-1774631871428.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/0898/20000898/docs_service_history-1774631430329.jpg?ixlib=js-3.8.0&auto=format&s=8c45b388e679c1ba98c8af93cc94052a'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1236450,
'Height': 2597,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_front_passenger-1774631375467.jpg',
'Width': 3462},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1141998,
'Height': 2345,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0898/20000898/exterior_rear_passenger-1774631351684.jpg',
'Width': 3127},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2969535,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0898/20000898/interior_rear_seats-1774631122138.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a251a4-0c06-5e31-b216-e20876e8c0be/18a251a4-0c06-5e31-b216-e20876e8c0be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2209680,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0898/20000898/instrument_cluster-1774631141348.jpg',
'Width': 3840}],
'price': 16195,
'price_includes_vat': False,
'registration_date': '2020-07-16',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Touran R Line TSI S-A',
'transmission': 'automatic',
'trim': 'R Line TSI S-A',
'vin': 'WVGZZZ1TZLW043472',
'year': 2020}
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720000898%27 HTTP/1.1" 200 None
2026-03-29 20:18:19 [motorway.uk] INFO: Saving data for 20000898: {'created_time': 1774815499.828864, 'last_price_update_time': 1774815499.82888, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20000898') HTTP/1.1" 204 0
2026-03-29 20:18:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 18a251a4-0c06-5e31-b216-e20876e8c0be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cec1b50>
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Finterior_dashboard-1774701301479.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/interior_dashboard-1774701301479.jpg saved to cache
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2af910>
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7094%252F20457094%252Finterior_boot-1774701308447.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7094/20457094/interior_boot-1774701308447.jpg saved to cache
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3f5d0>
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7094%252F20457094%252Finterior_rear_seats-1774701808994.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7094/20457094/interior_rear_seats-1774701808994.jpg saved to cache
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20424370.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_passenger-1774700238402.jpg> (referer: None)
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_rear_driver-1774700256618.jpg> (referer: None)
2026-03-29 20:18:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a580e9cb-83fc-556d-a761-3b4f10950d9e with identifier: 20424370
2026-03-29 20:18:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a580e9cb-83fc-556d-a761-3b4f10950d9e with scrape type 1
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_front_driver-1774704500703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_driver-1774704500703.jpg not downloaded yet
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_rear_driver-1774704496850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_driver-1774704496850.jpg not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_front_passenger-1774704513282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_passenger-1774704513282.jpg not downloaded yet
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd6250>
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Fexterior_front_passenger-1774700238402.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_passenger-1774700238402.jpg saved to cache
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebee2d0>
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Fexterior_rear_driver-1774700256618.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_rear_driver-1774700256618.jpg saved to cache
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_rear_passenger-1774704503641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_passenger-1774704503641.jpg not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4370%252F20424370%252Finterior_front_seats-1774705334160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4370/20424370/interior_front_seats-1774705334160.jpg not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4370%252F20424370%252Finterior_rear_seats-1774705396178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4370/20424370/interior_rear_seats-1774705396178.jpg not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Finterior_dashboard-1774705448807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/interior_dashboard-1774705448807.jpg not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4370%252F20424370%252Finterior_boot-1774705332306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4370/20424370/interior_boot-1774705332306.jpg not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4370%252F20424370%252Fdocs_service_history-1774706037260.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db497c3ee991871ec6ff52705b32a4987%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4370/20424370/docs_service_history-1774706037260.jpg?ixlib=js-3.8.0&auto=format&s=b497c3ee991871ec6ff52705b32a4987 not downloaded yet
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4370%252F20424370%252Fdocs_service_history-1774706103888.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D411eba7251cf1f835929846d4be4f871%27 HTTP/1.1" 200 None
2026-03-29 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4370/20424370/docs_service_history-1774706103888.jpg?ixlib=js-3.8.0&auto=format&s=411eba7251cf1f835929846d4be4f871 not downloaded yet
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_driver-1774700246526.jpg> (referer: None)
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_passenger-1774700584390.jpg> (referer: None)
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_passenger-1774700570390.jpg> (referer: None)
2026-03-29 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0616/20130616/interior_front_seats-1774701032089.jpg> (referer: None)
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24ddd0>
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7094%252F20457094%252Fexterior_front_driver-1774700246526.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_driver-1774700246526.jpg saved to cache
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126
2026-03-29 20:18:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc3ac7d0-c2a6-5e8a-a842-549e62bf8126, skipping ID generation
2026-03-29 20:18:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 with scrape type 1
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 sending to next pipeline
2026-03-29 20:18:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dc3ac7d0-c2a6-5e8a-a842-549e62bf8126, identifier: 20457094
2026-03-29 20:18:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 with identifier: 20457094
2026-03-29 20:18:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 with identifier: 20457094
2026-03-29 20:18:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dc3ac7d0-c2a6-5e8a-a842-549e62bf8126 with identifier: 20457094 to the API
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_driver-1774700246526.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dc3ac7d0-c2a6-5e8a-a842-549e62bf8126',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN71 FRK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20457094',
'listing': 'auction',
'location': 'Essex Colchester',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 7800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2040516,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_driver-1774700246526.jpg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938152,
'Height': 2404,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_rear_driver-1774700256618.jpg',
'Width': 3205},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1579130,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7094/20457094/exterior_front_passenger-1774700238402.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1985392,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7094/20457094/interior_rear_seats-1774701808994.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1561136,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7094/20457094/interior_dashboard-1774701301479.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1817815,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7094/20457094/instrument_cluster-1774701135280.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3ac7d0-c2a6-5e8a-a842-549e62bf8126/dc3ac7d0-c2a6-5e8a-a842-549e62bf8126_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3542107,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7094/20457094/interior_boot-1774701308447.jpg',
'Width': 3840}],
'price': 30377,
'price_includes_vat': False,
'registration_date': '2021-09-13',
'seats_number': None,
'seller_name': None,
'title': 'Toyota GR Yaris Circuit 4WD',
'transmission': 'manual',
'trim': 'GR Circuit 4WD',
'vin': 'JTDAF4E390A014244',
'year': 2021}
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457094%27 HTTP/1.1" 200 None
2026-03-29 20:18:21 [motorway.uk] INFO: Saving data for 20457094: {'created_time': 1774815501.564083, 'last_price_update_time': 1774815501.564097, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20457094') HTTP/1.1" 204 0
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d68d0>
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_front_passenger-1774700584390.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_passenger-1774700584390.jpg saved to cache
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2b1e10>
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_rear_passenger-1774700570390.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_passenger-1774700570390.jpg saved to cache
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:18:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4af90>
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0616%252F20130616%252Finterior_front_seats-1774701032089.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0616/20130616/interior_front_seats-1774701032089.jpg saved to cache
2026-03-29 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item a580e9cb-83fc-556d-a761-3b4f10950d9e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item a580e9cb-83fc-556d-a761-3b4f10950d9e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4370/20424370/interior_dashboard-1774705448807.jpg> (referer: None)
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4370/20424370/interior_boot-1774705332306.jpg> (referer: None)
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4370/20424370/interior_rear_seats-1774705396178.jpg> (referer: None)
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2b3790>
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Finterior_dashboard-1774705448807.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/interior_dashboard-1774705448807.jpg saved to cache
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d557f90>
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4370%252F20424370%252Finterior_boot-1774705332306.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4370/20424370/interior_boot-1774705332306.jpg saved to cache
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d8d10>
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4370%252F20424370%252Finterior_rear_seats-1774705396178.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4370/20424370/interior_rear_seats-1774705396178.jpg saved to cache
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4370/20424370/interior_front_seats-1774705334160.jpg> (referer: None)
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_passenger-1774704513282.jpg> (referer: None)
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_passenger-1774704503641.jpg> (referer: None)
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_driver-1774704496850.jpg> (referer: None)
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_driver-1774704500703.jpg> (referer: None)
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e59d0>
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4370%252F20424370%252Finterior_front_seats-1774705334160.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4370/20424370/interior_front_seats-1774705334160.jpg saved to cache
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_driver-1774700542534.jpg> (referer: None)
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d179310>
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_front_passenger-1774704513282.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_passenger-1774704513282.jpg saved to cache
2026-03-29 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03b590>
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_rear_passenger-1774704503641.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_passenger-1774704503641.jpg saved to cache
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22c090>
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_rear_driver-1774704496850.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_driver-1774704496850.jpg saved to cache
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22c650>
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4370%252F20424370%252Fexterior_front_driver-1774704500703.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_driver-1774704500703.jpg saved to cache
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a580e9cb-83fc-556d-a761-3b4f10950d9e
2026-03-29 20:18:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a580e9cb-83fc-556d-a761-3b4f10950d9e, skipping ID generation
2026-03-29 20:18:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a580e9cb-83fc-556d-a761-3b4f10950d9e with scrape type 1
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a580e9cb-83fc-556d-a761-3b4f10950d9e sending to next pipeline
2026-03-29 20:18:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a580e9cb-83fc-556d-a761-3b4f10950d9e, identifier: 20424370
2026-03-29 20:18:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a580e9cb-83fc-556d-a761-3b4f10950d9e with identifier: 20424370
2026-03-29 20:18:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a580e9cb-83fc-556d-a761-3b4f10950d9e with identifier: 20424370
2026-03-29 20:18:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a580e9cb-83fc-556d-a761-3b4f10950d9e with identifier: 20424370 to the API
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_driver-1774704500703.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a580e9cb-83fc-556d-a761-3b4f10950d9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VO67 ZSU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20424370',
'listing': 'auction',
'location': 'West Midlands Stourbridge',
'make': 'Peugeot',
'model': '208',
'odometer': 33382,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1327331,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_driver-1774704500703.jpg',
'Width': 3099},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1451814,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_driver-1774704496850.jpg',
'Width': 3334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1766701,
'Height': 2680,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_front_passenger-1774704513282.jpg',
'Width': 3573},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1536513,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4370/20424370/exterior_rear_passenger-1774704503641.jpg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672674,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4370/20424370/interior_front_seats-1774705334160.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1890080,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4370/20424370/interior_rear_seats-1774705396178.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1280953,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4370/20424370/interior_dashboard-1774705448807.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a580e9cb-83fc-556d-a761-3b4f10950d9e/a580e9cb-83fc-556d-a761-3b4f10950d9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1054901,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4370/20424370/interior_boot-1774705332306.jpg',
'Width': 3840}],
'price': 4714,
'price_includes_vat': False,
'registration_date': '2017-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 208 Active',
'transmission': 'manual',
'trim': 'Active',
'vin': 'VF3CCHMZ6HW129384',
'year': 2017}
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720424370%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [motorway.uk] INFO: Saving data for 20424370: {'created_time': 1774815503.747529, 'last_price_update_time': 1774815503.74754, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20424370') HTTP/1.1" 204 0
2026-03-29 20:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488257.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebe8e50>
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_front_driver-1774700542534.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_driver-1774700542534.jpg saved to cache
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:18:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8e754c-c1bd-5eba-a24c-88ebdc539b9c with identifier: 20488257
2026-03-29 20:18:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c with scrape type 1
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_front_driver-1774703727054.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_driver-1774703727054.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_rear_driver-1774703748181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_driver-1774703748181.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_front_passenger-1774703796384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_passenger-1774703796384.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_rear_passenger-1774703780595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_passenger-1774703780595.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8257%252F20488257%252Finterior_front_seats-1774704874005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8257/20488257/interior_front_seats-1774704874005.jpg not downloaded yet
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8257%252F20488257%252Finterior_rear_seats-1774705036217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8257/20488257/interior_rear_seats-1774705036217.jpg not downloaded yet
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Finterior_dashboard-1774704971423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/interior_dashboard-1774704971423.jpg not downloaded yet
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Finstrument_cluster-1774704952733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/instrument_cluster-1774704952733.jpg not downloaded yet
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8257%252F20488257%252Finterior_boot-1774704975655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8257/20488257/interior_boot-1774704975655.jpg not downloaded yet
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8257%252F20488257%252Fdocs_service_history-1774705854428.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D033ae5064ab8cb178495786c16c6bec8%27 HTTP/1.1" 200 None
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8257/20488257/docs_service_history-1774705854428.jpg?ixlib=js-3.8.0&auto=format&s=033ae5064ab8cb178495786c16c6bec8 not downloaded yet
2026-03-29 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_driver-1774700558071.jpg> (referer: None)
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2b9290>
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0616%252F20130616%252Fexterior_rear_driver-1774700558071.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_driver-1774700558071.jpg saved to cache
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90
2026-03-29 20:18:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90, skipping ID generation
2026-03-29 20:18:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 with scrape type 1
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 sending to next pipeline
2026-03-29 20:18:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90, identifier: 20130616
2026-03-29 20:18:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 with identifier: 20130616
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Brown HTTP/1.1" 200 None
2026-03-29 20:18:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:18:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 with identifier: 20130616
2026-03-29 20:18:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 66ce7e1a-c1da-5c65-a46b-c45e3bd66e90 with identifier: 20130616 to the API
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_driver-1774700558071.jpg>
{'auction_title': '',
'category': None,
'color': 'Brown',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '66ce7e1a-c1da-5c65-a46b-c45e3bd66e90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK13 XYT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20130616',
'listing': 'auction',
'location': 'Warwickshire Tamworth',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 66000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1477847,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_driver-1774700542534.jpg',
'Width': 3250},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1788757,
'Height': 2554,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_driver-1774700558071.jpg',
'Width': 3405},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1774968,
'Height': 2515,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_front_passenger-1774700584390.jpg',
'Width': 3353},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2026599,
'Height': 2966,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0616/20130616/exterior_rear_passenger-1774700570390.jpg',
'Width': 3955},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3148442,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0616/20130616/interior_front_seats-1774701032089.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2733475,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0616/20130616/interior_rear_seats-1774701040730.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3314938,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0616/20130616/interior_dashboard-1774701171464.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340043,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0616/20130616/instrument_cluster-1774701139149.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3072206,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0616/20130616/interior_boot-1774701099446.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ce7e1a-c1da-5c65-a46b-c45e3bd66e90/66ce7e1a-c1da-5c65-a46b-c45e3bd66e90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5229107,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0616/20130616/damage_scratches-1774700679887.jpg',
'Width': 4032}],
'price': 9057,
'price_includes_vat': False,
'registration_date': '2013-05-09',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Beetle 70S Edition',
'transmission': 'manual',
'trim': '70S Edition',
'vin': 'WVWZZZ16ZDM810949',
'year': 2013}
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720130616%27 HTTP/1.1" 200 None
2026-03-29 20:18:24 [motorway.uk] INFO: Saving data for 20130616: {'created_time': 1774815504.975997, 'last_price_update_time': 1774815504.976009, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20130616') HTTP/1.1" 204 0
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7406/20487406/instrument_cluster-1774703468640.jpg> (referer: None)
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7406/20487406/interior_dashboard-1774703407649.jpg> (referer: None)
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7406/20487406/interior_rear_seats-1774703376925.jpg> (referer: None)
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7406/20487406/interior_boot-1774703417497.jpg> (referer: None)
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2aebd0>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Finstrument_cluster-1774703468640.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/instrument_cluster-1774703468640.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef6950>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Finterior_dashboard-1774703407649.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/interior_dashboard-1774703407649.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c233150>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7406%252F20487406%252Finterior_rear_seats-1774703376925.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7406/20487406/interior_rear_seats-1774703376925.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea87610>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7406%252F20487406%252Finterior_boot-1774703417497.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7406/20487406/interior_boot-1774703417497.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8257/20488257/interior_boot-1774704975655.jpg> (referer: None)
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb96150>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8257%252F20488257%252Finterior_boot-1774704975655.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8257/20488257/interior_boot-1774704975655.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_passenger-1774703780595.jpg> (referer: None)
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd0f50>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_rear_passenger-1774703780595.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_passenger-1774703780595.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8257/20488257/interior_rear_seats-1774705036217.jpg> (referer: None)
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8257/20488257/instrument_cluster-1774704952733.jpg> (referer: None)
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8257/20488257/interior_front_seats-1774704874005.jpg> (referer: None)
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8257/20488257/interior_dashboard-1774704971423.jpg> (referer: None)
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_passenger-1774703796384.jpg> (referer: None)
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd7490>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8257%252F20488257%252Finterior_rear_seats-1774705036217.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8257/20488257/interior_rear_seats-1774705036217.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd0f10>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Finstrument_cluster-1774704952733.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/instrument_cluster-1774704952733.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea45450>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8257%252F20488257%252Finterior_front_seats-1774704874005.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8257/20488257/interior_front_seats-1774704874005.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca98950>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Finterior_dashboard-1774704971423.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/interior_dashboard-1774704971423.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca3fd50>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_front_passenger-1774703796384.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_passenger-1774703796384.jpg saved to cache
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_driver-1774703748181.jpg> (referer: None)
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d505350>
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_rear_driver-1774703748181.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_driver-1774703748181.jpg saved to cache
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_driver-1774703727054.jpg> (referer: None)
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_passenger-1774702850084.jpg> (referer: None)
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_passenger-1774702732212.jpg> (referer: None)
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_driver-1774702864102.jpg> (referer: None)
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d0750>
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8257%252F20488257%252Fexterior_front_driver-1774703727054.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_driver-1774703727054.jpg saved to cache
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c
2026-03-29 20:18:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc8e754c-c1bd-5eba-a24c-88ebdc539b9c, skipping ID generation
2026-03-29 20:18:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c with scrape type 1
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc8e754c-c1bd-5eba-a24c-88ebdc539b9c sending to next pipeline
2026-03-29 20:18:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fc8e754c-c1bd-5eba-a24c-88ebdc539b9c, identifier: 20488257
2026-03-29 20:18:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fc8e754c-c1bd-5eba-a24c-88ebdc539b9c with identifier: 20488257
2026-03-29 20:18:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fc8e754c-c1bd-5eba-a24c-88ebdc539b9c with identifier: 20488257
2026-03-29 20:18:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fc8e754c-c1bd-5eba-a24c-88ebdc539b9c with identifier: 20488257 to the API
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_driver-1774703727054.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fc8e754c-c1bd-5eba-a24c-88ebdc539b9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YT21 HLX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488257',
'listing': 'auction',
'location': 'Stockton-on-Tees Billingham',
'make': 'Audi',
'model': 'A1',
'odometer': 67000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1060778,
'Height': 2054,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_driver-1774703727054.jpg',
'Width': 2738},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1221150,
'Height': 2260,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_driver-1774703748181.jpg',
'Width': 3013},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1220386,
'Height': 2001,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_front_passenger-1774703796384.jpg',
'Width': 2668},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1331277,
'Height': 2181,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8257/20488257/exterior_rear_passenger-1774703780595.jpg',
'Width': 2908},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3492463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8257/20488257/interior_front_seats-1774704874005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4602278,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8257/20488257/interior_rear_seats-1774705036217.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3061696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8257/20488257/interior_dashboard-1774704971423.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2334350,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8257/20488257/instrument_cluster-1774704952733.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc8e754c-c1bd-5eba-a24c-88ebdc539b9c/fc8e754c-c1bd-5eba-a24c-88ebdc539b9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3400034,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8257/20488257/interior_boot-1774704975655.jpg',
'Width': 4032}],
'price': 11815,
'price_includes_vat': False,
'registration_date': '2021-03-02',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line Black ED 30 TFSI',
'transmission': 'manual',
'trim': 'S Line Black ED 30 TFSI',
'vin': 'WAUZZZGB2MR026283',
'year': 2021}
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488257%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [motorway.uk] INFO: Saving data for 20488257: {'created_time': 1774815507.994287, 'last_price_update_time': 1774815507.9943, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488257') HTTP/1.1" 204 0
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec64550>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_front_passenger-1774702850084.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_passenger-1774702850084.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05b7d0>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_rear_passenger-1774702732212.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_passenger-1774702732212.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea44650>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_rear_driver-1774702864102.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_driver-1774702864102.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_driver-1774702958517.jpg> (referer: None)
2026-03-29 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7406/20487406/interior_front_seats-1774703363407.jpg> (referer: None)
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07d750>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7406%252F20487406%252Fexterior_front_driver-1774702958517.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_driver-1774702958517.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d242f50>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7406%252F20487406%252Finterior_front_seats-1774703363407.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7406/20487406/interior_front_seats-1774703363407.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac6871dd-eca1-51f4-b783-8c166b764a2c
2026-03-29 20:18:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac6871dd-eca1-51f4-b783-8c166b764a2c, skipping ID generation
2026-03-29 20:18:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac6871dd-eca1-51f4-b783-8c166b764a2c with scrape type 1
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac6871dd-eca1-51f4-b783-8c166b764a2c sending to next pipeline
2026-03-29 20:18:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ac6871dd-eca1-51f4-b783-8c166b764a2c, identifier: 20487406
2026-03-29 20:18:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ac6871dd-eca1-51f4-b783-8c166b764a2c with identifier: 20487406
2026-03-29 20:18:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ac6871dd-eca1-51f4-b783-8c166b764a2c with identifier: 20487406
2026-03-29 20:18:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ac6871dd-eca1-51f4-b783-8c166b764a2c with identifier: 20487406 to the API
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7406/20487406/interior_front_seats-1774703363407.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ac6871dd-eca1-51f4-b783-8c166b764a2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC69 YMV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487406',
'listing': 'auction',
'location': 'Essex Clacton-on-Sea',
'make': 'Ford',
'model': 'Tourneo',
'odometer': 58106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1200993,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_driver-1774702958517.jpg',
'Width': 3527},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775212,
'Height': 2030,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_driver-1774702864102.jpg',
'Width': 2706},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 978983,
'Height': 2185,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_front_passenger-1774702850084.jpg',
'Width': 2913},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720463,
'Height': 2027,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7406/20487406/exterior_rear_passenger-1774702732212.jpg',
'Width': 2703},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2812668,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7406/20487406/interior_front_seats-1774703363407.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2939255,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7406/20487406/interior_rear_seats-1774703376925.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2998493,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7406/20487406/interior_dashboard-1774703407649.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685597,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7406/20487406/instrument_cluster-1774703468640.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac6871dd-eca1-51f4-b783-8c166b764a2c/ac6871dd-eca1-51f4-b783-8c166b764a2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3979161,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7406/20487406/interior_boot-1774703417497.jpg',
'Width': 4032}],
'price': 5743,
'price_includes_vat': False,
'registration_date': '2019-09-27',
'seats_number': None,
'seller_name': None,
'title': 'Ford Tourneo Courier Zetec',
'transmission': 'manual',
'trim': 'Courier Zetec',
'vin': 'WF0LXXTACLKY65974',
'year': 2019}
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487406%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [motorway.uk] INFO: Saving data for 20487406: {'created_time': 1774815509.206718, 'last_price_update_time': 1774815509.206728, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487406') HTTP/1.1" 204 0
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19486980.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a7a224-e8ee-5df5-b0ee-d2026ad89714 with identifier: 19486980
2026-03-29 20:18:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714 with scrape type 1
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_front_driver-1774695103079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_driver-1774695103079.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_rear_driver-1774695163184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_driver-1774695163184.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_front_passenger-1774695124702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_passenger-1774695124702.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_rear_passenger-1774695143734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_passenger-1774695143734.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6980%252F19486980%252Finterior_front_seats-1774695180242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6980/19486980/interior_front_seats-1774695180242.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6980%252F19486980%252Finterior_rear_seats-1774695216354.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6980/19486980/interior_rear_seats-1774695216354.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Finterior_dashboard-1774695459300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/interior_dashboard-1774695459300.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Finstrument_cluster-1774695325589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/instrument_cluster-1774695325589.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6980%252F19486980%252Finterior_boot-1774695284605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6980/19486980/interior_boot-1774695284605.jpg not downloaded yet
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6980%252F19486980%252Fdocs_service_history-1774700292963.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03808b4bf6dbc1b558246ad01bab6345%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6980/19486980/docs_service_history-1774700292963.jpg?ixlib=js-3.8.0&auto=format&s=03808b4bf6dbc1b558246ad01bab6345 not downloaded yet
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7634/20487634/wheels_front_driver-1774701603111.jpg> (referer: None)
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e065690>
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fwheels_front_driver-1774701603111.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/wheels_front_driver-1774701603111.jpg saved to cache
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6980/19486980/docs_service_history-1774700292963.jpg?ixlib=js-3.8.0&auto=format&s=03808b4bf6dbc1b558246ad01bab6345> (referer: None)
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b6510>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6980%252F19486980%252Fdocs_service_history-1774700292963.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03808b4bf6dbc1b558246ad01bab6345') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6980/19486980/docs_service_history-1774700292963.jpg?ixlib=js-3.8.0&auto=format&s=03808b4bf6dbc1b558246ad01bab6345 saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6980/19486980/interior_boot-1774695284605.jpg> (referer: None)
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d038550>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6980%252F19486980%252Finterior_boot-1774695284605.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6980/19486980/interior_boot-1774695284605.jpg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6980/19486980/instrument_cluster-1774695325589.jpg> (referer: None)
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b4650>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Finstrument_cluster-1774695325589.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/instrument_cluster-1774695325589.jpg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6980/19486980/interior_dashboard-1774695459300.jpg> (referer: None)
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e064ad0>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Finterior_dashboard-1774695459300.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/interior_dashboard-1774695459300.jpg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6980/19486980/interior_rear_seats-1774695216354.jpg> (referer: None)
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafab50>
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6980%252F19486980%252Finterior_rear_seats-1774695216354.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6980/19486980/interior_rear_seats-1774695216354.jpg saved to cache
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6980/19486980/interior_front_seats-1774695180242.jpg> (referer: None)
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b6690>
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6980%252F19486980%252Finterior_front_seats-1774695180242.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6980/19486980/interior_front_seats-1774695180242.jpg saved to cache
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_passenger-1774695143734.jpg> (referer: None)
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e064110>
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_rear_passenger-1774695143734.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_passenger-1774695143734.jpg saved to cache
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_passenger-1774695124702.jpg> (referer: None)
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb01850>
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_front_passenger-1774695124702.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_passenger-1774695124702.jpg saved to cache
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_driver-1774695163184.jpg> (referer: None)
2026-03-29 20:18:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15916141.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e067290>
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_rear_driver-1774695163184.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_driver-1774695163184.jpg saved to cache
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b with identifier: 15916141
2026-03-29 20:18:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b with scrape type 1
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_front_driver-1774709797511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_driver-1774709797511.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_rear_driver-1774709857218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_driver-1774709857218.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_front_passenger-1774709825420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_passenger-1774709825420.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_rear_passenger-1774709839859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_passenger-1774709839859.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F15916141%252Finterior_front_seats-1774710992241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/15916141/interior_front_seats-1774710992241.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F15916141%252Finterior_rear_seats-1774711005150.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/15916141/interior_rear_seats-1774711005150.jpg not downloaded yet
2026-03-29 20:18:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_driver-1774695103079.jpg> (referer: None)
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6141%252F15916141%252Finterior_dashboard-1774774114479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6141/15916141/interior_dashboard-1774774114479.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Finstrument_cluster-1774711033969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/instrument_cluster-1774711033969.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F15916141%252Finterior_boot-1774711049712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/15916141/interior_boot-1774711049712.jpg not downloaded yet
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6141%252F15916141%252Fdocs_service_history-1774711287891.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc28c1eb6584b389b4bdf5bd9bf54c9e4%27 HTTP/1.1" 200 None
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6141/15916141/docs_service_history-1774711287891.jpg?ixlib=js-3.8.0&auto=format&s=c28c1eb6584b389b4bdf5bd9bf54c9e4 not downloaded yet
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2bb550>
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6980%252F19486980%252Fexterior_front_driver-1774695103079.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_driver-1774695103079.jpg saved to cache
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714
2026-03-29 20:18:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2a7a224-e8ee-5df5-b0ee-d2026ad89714, skipping ID generation
2026-03-29 20:18:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714 with scrape type 1
2026-03-29 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2a7a224-e8ee-5df5-b0ee-d2026ad89714 sending to next pipeline
2026-03-29 20:18:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b2a7a224-e8ee-5df5-b0ee-d2026ad89714, identifier: 19486980
2026-03-29 20:18:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b2a7a224-e8ee-5df5-b0ee-d2026ad89714 with identifier: 19486980
2026-03-29 20:18:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b2a7a224-e8ee-5df5-b0ee-d2026ad89714 with identifier: 19486980
2026-03-29 20:18:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b2a7a224-e8ee-5df5-b0ee-d2026ad89714 with identifier: 19486980 to the API
2026-03-29 20:18:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_driver-1774695103079.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b2a7a224-e8ee-5df5-b0ee-d2026ad89714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU22 LRX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19486980',
'listing': 'auction',
'location': 'North Yorkshire Knaresborough',
'make': 'BMW',
'model': '4 Series',
'odometer': 33617,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 795190,
'Height': 1740,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_driver-1774695103079.jpg',
'Width': 2320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676853,
'Height': 1773,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_driver-1774695163184.jpg',
'Width': 2364},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1215263,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_front_passenger-1774695124702.jpg',
'Width': 2983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1189467,
'Height': 2054,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6980/19486980/exterior_rear_passenger-1774695143734.jpg',
'Width': 2739},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1833948,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6980/19486980/interior_front_seats-1774695180242.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1015068,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6980/19486980/interior_rear_seats-1774695216354.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870135,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6980/19486980/interior_dashboard-1774695459300.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520450,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6980/19486980/instrument_cluster-1774695325589.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2037632,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6980/19486980/interior_boot-1774695284605.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a7a224-e8ee-5df5-b0ee-d2026ad89714/b2a7a224-e8ee-5df5-b0ee-d2026ad89714_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1213124,
'Height': 12866,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6980/19486980/docs_service_history-1774700292963.jpg?ixlib=js-3.8.0&auto=format&s=03808b4bf6dbc1b558246ad01bab6345',
'Width': 1440}],
'price': 28419,
'price_includes_vat': False,
'registration_date': '2022-03-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW 430D xDrive M Sport MHEV Auto',
'transmission': 'automatic',
'trim': '430D xDrive M Sport MHEV Auto',
'vin': 'WBA42AS0X0CJ20382',
'year': 2022}
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719486980%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [motorway.uk] INFO: Saving data for 19486980: {'created_time': 1774815514.23104, 'last_price_update_time': 1774815514.231052, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19486980') HTTP/1.1" 204 0
2026-03-29 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5249/8725249/interior_dashboard-1774714119289.jpg> (referer: None)
2026-03-29 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6141/15916141/interior_rear_seats-1774711005150.jpg> (referer: None)
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc158e12d0>
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Finterior_dashboard-1774714119289.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/interior_dashboard-1774714119289.jpg saved to cache
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad6950>
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F15916141%252Finterior_rear_seats-1774711005150.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/15916141/interior_rear_seats-1774711005150.jpg saved to cache
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6141/15916141/docs_service_history-1774711287891.jpg?ixlib=js-3.8.0&auto=format&s=c28c1eb6584b389b4bdf5bd9bf54c9e4> (referer: None)
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce71e90>
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6141%252F15916141%252Fdocs_service_history-1774711287891.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc28c1eb6584b389b4bdf5bd9bf54c9e4') HTTP/1.1" 204 0
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6141/15916141/docs_service_history-1774711287891.jpg?ixlib=js-3.8.0&auto=format&s=c28c1eb6584b389b4bdf5bd9bf54c9e4 saved to cache
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/15916141/instrument_cluster-1774711033969.jpg> (referer: None)
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad6b90>
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Finstrument_cluster-1774711033969.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/instrument_cluster-1774711033969.jpg saved to cache
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19585852.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6141/15916141/interior_boot-1774711049712.jpg> (referer: None)
2026-03-29 20:18:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a10348-1628-5a5e-8b93-ad7e1241013c with identifier: 19585852
2026-03-29 20:18:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a10348-1628-5a5e-8b93-ad7e1241013c with scrape type 1
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_front_driver-1774695197331.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_driver-1774695197331.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_rear_driver-1774695990476.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_driver-1774695990476.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_front_passenger-1774695193452.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_passenger-1774695193452.jpeg not downloaded yet
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1d6950>
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F15916141%252Finterior_boot-1774711049712.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/15916141/interior_boot-1774711049712.jpg saved to cache
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_rear_passenger-1774695991749.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_passenger-1774695991749.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5852%252F19585852%252Finterior_front_seats-1774695922441.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5852/19585852/interior_front_seats-1774695922441.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5852%252F19585852%252Finterior_rear_seats-1774695429114.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5852/19585852/interior_rear_seats-1774695429114.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Finterior_dashboard-1774695465933.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/interior_dashboard-1774695465933.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Finstrument_cluster-1774695655424.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/instrument_cluster-1774695655424.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5852%252F19585852%252Finterior_boot-1774695470011.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5852/19585852/interior_boot-1774695470011.jpeg not downloaded yet
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5852%252F19585852%252Fdocs_service_history-1774696518118.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c83024b262f787071de7ae9ac460b60%27 HTTP/1.1" 200 None
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5852/19585852/docs_service_history-1774696518118.jpeg?ixlib=js-3.8.0&auto=format&s=8c83024b262f787071de7ae9ac460b60 not downloaded yet
2026-03-29 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_passenger-1774709839859.jpg> (referer: None)
2026-03-29 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6141/15916141/interior_front_seats-1774710992241.jpg> (referer: None)
2026-03-29 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6141/15916141/interior_dashboard-1774774114479.jpg> (referer: None)
2026-03-29 20:18:35 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13594722) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5852/19585852/interior_boot-1774695470011.jpeg>.
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c240f50>
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_rear_passenger-1774709839859.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_passenger-1774709839859.jpg saved to cache
2026-03-29 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5852/19585852/docs_service_history-1774696518118.jpeg?ixlib=js-3.8.0&auto=format&s=8c83024b262f787071de7ae9ac460b60> (referer: None)
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58e290>
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F15916141%252Finterior_front_seats-1774710992241.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/15916141/interior_front_seats-1774710992241.jpg saved to cache
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13bd10>
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6141%252F15916141%252Finterior_dashboard-1774774114479.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6141/15916141/interior_dashboard-1774774114479.jpg saved to cache
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20257823.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e065dd0>
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5852%252F19585852%252Fdocs_service_history-1774696518118.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c83024b262f787071de7ae9ac460b60') HTTP/1.1" 204 0
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5852/19585852/docs_service_history-1774696518118.jpeg?ixlib=js-3.8.0&auto=format&s=8c83024b262f787071de7ae9ac460b60 saved to cache
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 with identifier: 20257823
2026-03-29 20:18:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 with scrape type 1
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_front_driver-1774630586561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_driver-1774630586561.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_rear_driver-1774630605917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_driver-1774630605917.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_front_passenger-1774630632425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_passenger-1774630632425.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_rear_passenger-1774630623510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_passenger-1774630623510.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7823%252F20257823%252Finterior_front_seats-1774631226907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7823/20257823/interior_front_seats-1774631226907.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Finterior_dashboard-1774631259685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/interior_dashboard-1774631259685.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7823%252F20257823%252Finterior_boot-1774631612752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7823/20257823/interior_boot-1774631612752.jpg not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7823%252F20257823%252Fdocs_service_history-1774631864680.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9eaa0bde4ec0f9f7516d9283201db172%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631864680.jpg?ixlib=js-3.8.0&auto=format&s=9eaa0bde4ec0f9f7516d9283201db172 not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7823%252F20257823%252Fdocs_service_history-1774631892669.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde1317de4f1aea23b5d1d41496708732%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631892669.jpg?ixlib=js-3.8.0&auto=format&s=de1317de4f1aea23b5d1d41496708732 not downloaded yet
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7823%252F20257823%252Fdamage_scratches-1774630722098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7823/20257823/damage_scratches-1774630722098.jpg not downloaded yet
2026-03-29 20:18:36 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5852/19585852/interior_boot-1774695470011.jpeg>.
2026-03-29 20:18:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5852/19585852/instrument_cluster-1774695655424.jpeg> (referer: None)
2026-03-29 20:18:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5852/19585852/interior_boot-1774695470011.jpeg> (referer: None)
2026-03-29 20:18:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5852/19585852/interior_dashboard-1774695465933.jpeg> (referer: None)
2026-03-29 20:18:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00_\xb5\x8d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xba\xaa\x00_\xab\x89\x00\x00\x00\x00'
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13e2d0>
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Finstrument_cluster-1774695655424.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/instrument_cluster-1774695655424.jpeg saved to cache
2026-03-29 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc5\x1fu\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\nP\xed\x00\xc5\x15q\x00\x00\x00\x00'
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d014650>
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5852%252F19585852%252Finterior_boot-1774695470011.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5852/19585852/interior_boot-1774695470011.jpeg saved to cache
2026-03-29 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x8e\x1d\xca\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\x13f\x00\x8e\x13\xc6\x00\x00\x00\x00'
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d243fd0>
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Finterior_dashboard-1774695465933.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/interior_dashboard-1774695465933.jpeg saved to cache
2026-03-29 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5852/19585852/interior_rear_seats-1774695429114.jpeg> (referer: None)
2026-03-29 20:18:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x97\x95\x04\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07K&\x00\x97\x8b\x00\x00\x00\x00\x00'
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fd9d0>
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5852%252F19585852%252Finterior_rear_seats-1774695429114.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5852/19585852/interior_rear_seats-1774695429114.jpeg saved to cache
2026-03-29 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631892669.jpg?ixlib=js-3.8.0&auto=format&s=de1317de4f1aea23b5d1d41496708732> (referer: None)
2026-03-29 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7823/20257823/damage_scratches-1774630722098.jpg> (referer: None)
2026-03-29 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631864680.jpg?ixlib=js-3.8.0&auto=format&s=9eaa0bde4ec0f9f7516d9283201db172> (referer: None)
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad1ad0>
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7823%252F20257823%252Fdocs_service_history-1774631892669.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde1317de4f1aea23b5d1d41496708732') HTTP/1.1" 204 0
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631892669.jpg?ixlib=js-3.8.0&auto=format&s=de1317de4f1aea23b5d1d41496708732 saved to cache
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9cd90>
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7823%252F20257823%252Fdamage_scratches-1774630722098.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7823/20257823/damage_scratches-1774630722098.jpg saved to cache
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d771e10>
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7823%252F20257823%252Fdocs_service_history-1774631864680.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9eaa0bde4ec0f9f7516d9283201db172') HTTP/1.1" 204 0
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631864680.jpg?ixlib=js-3.8.0&auto=format&s=9eaa0bde4ec0f9f7516d9283201db172 saved to cache
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7823/20257823/interior_dashboard-1774631259685.jpg> (referer: None)
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7823/20257823/interior_boot-1774631612752.jpg> (referer: None)
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdea90>
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Finterior_dashboard-1774631259685.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/interior_dashboard-1774631259685.jpg saved to cache
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef5f90>
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7823%252F20257823%252Finterior_boot-1774631612752.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7823/20257823/interior_boot-1774631612752.jpg saved to cache
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7823/20257823/interior_front_seats-1774631226907.jpg> (referer: None)
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_passenger-1774630623510.jpg> (referer: None)
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_passenger-1774630632425.jpg> (referer: None)
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_driver-1774630586561.jpg> (referer: None)
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7ad10>
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7823%252F20257823%252Finterior_front_seats-1774631226907.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7823/20257823/interior_front_seats-1774631226907.jpg saved to cache
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad34d0>
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_rear_passenger-1774630623510.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_passenger-1774630623510.jpg saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07d2d0>
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_front_passenger-1774630632425.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_passenger-1774630632425.jpg saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c631b10>
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_front_driver-1774630586561.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_driver-1774630586561.jpg saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_driver-1774630605917.jpg> (referer: None)
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d270790>
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7823%252F20257823%252Fexterior_rear_driver-1774630605917.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_driver-1774630605917.jpg saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467
2026-03-29 20:18:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 737d3eb3-3d5c-5401-91ea-1fa7c5f82467, skipping ID generation
2026-03-29 20:18:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 with scrape type 1
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 sending to next pipeline
2026-03-29 20:18:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 737d3eb3-3d5c-5401-91ea-1fa7c5f82467, identifier: 20257823
2026-03-29 20:18:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 with identifier: 20257823
2026-03-29 20:18:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 with identifier: 20257823
2026-03-29 20:18:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 737d3eb3-3d5c-5401-91ea-1fa7c5f82467 with identifier: 20257823 to the API
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_driver-1774630605917.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '737d3eb3-3d5c-5401-91ea-1fa7c5f82467',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WR17 GGK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20257823',
'listing': 'auction',
'location': 'Wiltshire Swindon',
'make': 'BMW',
'model': 'Z4',
'odometer': 37000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1354966,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_driver-1774630586561.jpg',
'Width': 3102},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1299339,
'Height': 2326,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_driver-1774630605917.jpg',
'Width': 3101},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1532580,
'Height': 2405,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_front_passenger-1774630632425.jpg',
'Width': 3206},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024313,
'Height': 2723,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7823/20257823/exterior_rear_passenger-1774630623510.jpg',
'Width': 3630},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3765495,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7823/20257823/interior_front_seats-1774631226907.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3483547,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7823/20257823/interior_dashboard-1774631259685.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3636941,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7823/20257823/interior_boot-1774631612752.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350638,
'Height': 2834,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631864680.jpg?ixlib=js-3.8.0&auto=format&s=9eaa0bde4ec0f9f7516d9283201db172',
'Width': 4392},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 962235,
'Height': 2586,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7823/20257823/docs_service_history-1774631892669.jpg?ixlib=js-3.8.0&auto=format&s=de1317de4f1aea23b5d1d41496708732',
'Width': 4110},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737d3eb3-3d5c-5401-91ea-1fa7c5f82467/737d3eb3-3d5c-5401-91ea-1fa7c5f82467_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2687772,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7823/20257823/damage_scratches-1774630722098.jpg',
'Width': 4032}],
'price': 14728,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seats_number': None,
'seller_name': None,
'title': 'BMW Z4 SDRIVE20I M Sport Auto',
'transmission': 'automatic',
'trim': 'SDRIVE20I M Sport Auto',
'vin': 'WBALL32070J085168',
'year': 2017}
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720257823%27 HTTP/1.1" 200 None
2026-03-29 20:18:40 [motorway.uk] INFO: Saving data for 20257823: {'created_time': 1774815520.266027, 'last_price_update_time': 1774815520.266038, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20257823') HTTP/1.1" 204 0
2026-03-29 20:18:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.361(s), this was the 1st time calling it.
2026-03-29 20:18:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.0345543130705765 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_driver-1774695990476.jpeg> (referer: None)
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_passenger-1774695193452.jpeg> (referer: None)
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_passenger-1774695991749.jpeg> (referer: None)
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5852/19585852/interior_front_seats-1774695922441.jpeg> (referer: None)
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed81590>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_rear_driver-1774695990476.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_driver-1774695990476.jpeg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf032d0>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_front_passenger-1774695193452.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_passenger-1774695193452.jpeg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb96ed0>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_rear_passenger-1774695991749.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_passenger-1774695991749.jpeg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00yZ\x1e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xd7T\x00yP\x1a\x00\x00\x00\x00'
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c216190>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5852%252F19585852%252Finterior_front_seats-1774695922441.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5852/19585852/interior_front_seats-1774695922441.jpeg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_driver-1774709797511.jpg> (referer: None)
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_passenger-1774709825420.jpg> (referer: None)
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef5610>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_front_driver-1774709797511.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_driver-1774709797511.jpg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea84450>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_front_passenger-1774709825420.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_passenger-1774709825420.jpg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_driver-1774709857218.jpg> (referer: None)
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7634/20487634/interior_boot-1774701896163.jpg> (referer: None)
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca3df50>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F15916141%252Fexterior_rear_driver-1774709857218.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_driver-1774709857218.jpg saved to cache
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b
2026-03-29 20:18:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b, skipping ID generation
2026-03-29 20:18:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b with scrape type 1
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b sending to next pipeline
2026-03-29 20:18:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b, identifier: 15916141
2026-03-29 20:18:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b with identifier: 15916141
2026-03-29 20:18:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b with identifier: 15916141
2026-03-29 20:18:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b with identifier: 15916141 to the API
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_driver-1774709857218.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BK18 ZVU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15916141',
'listing': 'auction',
'location': 'Staffordshire Walsall',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 59475,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505255,
'Height': 2276,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_driver-1774709797511.jpg',
'Width': 3034},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1670895,
'Height': 2346,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_driver-1774709857218.jpg',
'Width': 3128},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1508109,
'Height': 2432,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_front_passenger-1774709825420.jpg',
'Width': 3243},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1624629,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/15916141/exterior_rear_passenger-1774709839859.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3081634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6141/15916141/interior_front_seats-1774710992241.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2831881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6141/15916141/interior_rear_seats-1774711005150.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3003342,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6141/15916141/interior_dashboard-1774774114479.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2314482,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/15916141/instrument_cluster-1774711033969.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3806104,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6141/15916141/interior_boot-1774711049712.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b/90fd8cc7-48fe-55c4-9072-c14c9ed0fb4b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 896802,
'Height': 1373,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6141/15916141/docs_service_history-1774711287891.jpg?ixlib=js-3.8.0&auto=format&s=c28c1eb6584b389b4bdf5bd9bf54c9e4',
'Width': 1786}],
'price': 10431,
'price_includes_vat': False,
'registration_date': '2018-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Vitara S Boosterjet Allgrip A',
'transmission': 'automatic',
'trim': 'S Boosterjet Allgrip A',
'vin': 'TSMLYEA1S00442291',
'year': 2018}
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715916141%27 HTTP/1.1" 200 None
2026-03-29 20:18:42 [motorway.uk] INFO: Saving data for 15916141: {'created_time': 1774815522.521304, 'last_price_update_time': 1774815522.521316, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15916141') HTTP/1.1" 204 0
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fe750>
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7634%252F20487634%252Finterior_boot-1774701896163.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7634/20487634/interior_boot-1774701896163.jpg saved to cache
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5249/8725249/interior_rear_seats-1774714041111.jpg> (referer: None)
2026-03-29 20:18:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_driver-1774695197331.jpeg> (referer: None)
2026-03-29 20:18:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7634/20487634/instrument_cluster-1774701937614.jpg> (referer: None)
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e072c90>
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F8725249%252Finterior_rear_seats-1774714041111.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/8725249/interior_rear_seats-1774714041111.jpg saved to cache
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2413d0>
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5852%252F19585852%252Fexterior_front_driver-1774695197331.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_driver-1774695197331.jpeg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6a10348-1628-5a5e-8b93-ad7e1241013c
2026-03-29 20:18:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6a10348-1628-5a5e-8b93-ad7e1241013c, skipping ID generation
2026-03-29 20:18:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a10348-1628-5a5e-8b93-ad7e1241013c with scrape type 1
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6a10348-1628-5a5e-8b93-ad7e1241013c sending to next pipeline
2026-03-29 20:18:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c6a10348-1628-5a5e-8b93-ad7e1241013c, identifier: 19585852
2026-03-29 20:18:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:18:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fc990>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Finstrument_cluster-1774701937614.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/instrument_cluster-1774701937614.jpg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c6a10348-1628-5a5e-8b93-ad7e1241013c with identifier: 19585852
2026-03-29 20:18:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c6a10348-1628-5a5e-8b93-ad7e1241013c with identifier: 19585852
2026-03-29 20:18:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c6a10348-1628-5a5e-8b93-ad7e1241013c with identifier: 19585852 to the API
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_driver-1774695197331.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c6a10348-1628-5a5e-8b93-ad7e1241013c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FV21 TTZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19585852',
'listing': 'auction',
'location': 'West Sussex Billingshurst',
'make': 'Honda',
'model': 'Civic',
'odometer': 26749,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6837657,
'Height': 5340,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_driver-1774695197331.jpeg',
'Width': 7120},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7249979,
'Height': 5717,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_driver-1774695990476.jpeg',
'Width': 7622},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7217302,
'Height': 5574,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_front_passenger-1774695193452.jpeg',
'Width': 7432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7072069,
'Height': 5824,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5852/19585852/exterior_rear_passenger-1774695991749.jpeg',
'Width': 7765},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8335730,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5852/19585852/interior_front_seats-1774695922441.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 10412074,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5852/19585852/interior_rear_seats-1774695429114.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 9777456,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5852/19585852/interior_dashboard-1774695465933.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 6582327,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5852/19585852/instrument_cluster-1774695655424.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13594722,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5852/19585852/interior_boot-1774695470011.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a10348-1628-5a5e-8b93-ad7e1241013c/c6a10348-1628-5a5e-8b93-ad7e1241013c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1336034,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5852/19585852/docs_service_history-1774696518118.jpeg?ixlib=js-3.8.0&auto=format&s=8c83024b262f787071de7ae9ac460b60',
'Width': 4032}],
'price': 30975,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Honda Civic Type R GT',
'transmission': 'manual',
'trim': 'Type R GT',
'vin': 'SHHFK8790MU000961',
'year': 2021}
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719585852%27 HTTP/1.1" 200 None
2026-03-29 20:18:43 [motorway.uk] INFO: Saving data for 19585852: {'created_time': 1774815523.797573, 'last_price_update_time': 1774815523.797587, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19585852') HTTP/1.1" 204 0
2026-03-29 20:18:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.832(s), this was the 1st time calling it.
2026-03-29 20:18:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.525304547925378 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_passenger-1774713579339.jpg> (referer: None)
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7634/20487634/interior_dashboard-1774704194390.jpg> (referer: None)
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021490>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_rear_passenger-1774713579339.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_passenger-1774713579339.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c404290>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7634%252F20487634%252Finterior_dashboard-1774704194390.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7634/20487634/interior_dashboard-1774704194390.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_passenger-1774713592323.jpg> (referer: None)
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_driver-1774713568389.jpg> (referer: None)
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7634/20487634/interior_rear_seats-1774701899765.jpg> (referer: None)
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7634/20487634/interior_front_seats-1774701898591.jpg> (referer: None)
2026-03-29 20:18:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071a10>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_front_passenger-1774713592323.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_passenger-1774713592323.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fea10>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_rear_driver-1774713568389.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_driver-1774713568389.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d271e10>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7634%252F20487634%252Finterior_rear_seats-1774701899765.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7634/20487634/interior_rear_seats-1774701899765.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1c90>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7634%252F20487634%252Finterior_front_seats-1774701898591.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7634/20487634/interior_front_seats-1774701898591.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_driver-1774713545985.jpg> (referer: None)
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_passenger-1774701488326.jpg> (referer: None)
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_driver-1774701463854.jpg> (referer: None)
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d131910>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F8725249%252Fexterior_front_driver-1774713545985.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_driver-1774713545985.jpg saved to cache
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42a6a634-36f4-52a8-8072-7b24fd70e375
2026-03-29 20:18:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42a6a634-36f4-52a8-8072-7b24fd70e375, skipping ID generation
2026-03-29 20:18:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a6a634-36f4-52a8-8072-7b24fd70e375 with scrape type 1
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42a6a634-36f4-52a8-8072-7b24fd70e375 sending to next pipeline
2026-03-29 20:18:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 42a6a634-36f4-52a8-8072-7b24fd70e375, identifier: 8725249
2026-03-29 20:18:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 42a6a634-36f4-52a8-8072-7b24fd70e375 with identifier: 8725249
2026-03-29 20:18:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 42a6a634-36f4-52a8-8072-7b24fd70e375 with identifier: 8725249
2026-03-29 20:18:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 42a6a634-36f4-52a8-8072-7b24fd70e375 with identifier: 8725249 to the API
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_driver-1774713545985.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '42a6a634-36f4-52a8-8072-7b24fd70e375',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YY66 DFX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8725249',
'listing': 'auction',
'location': 'Hampshire Basingstoke',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 65767,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2146868,
'Height': 2618,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_driver-1774713545985.jpg',
'Width': 3491},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627166,
'Height': 2430,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_driver-1774713568389.jpg',
'Width': 3240},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1165304,
'Height': 2287,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_front_passenger-1774713592323.jpg',
'Width': 3049},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630508,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5249/8725249/exterior_rear_passenger-1774713579339.jpg',
'Width': 3254},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3522136,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5249/8725249/interior_front_seats-1774714016265.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3088812,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5249/8725249/interior_rear_seats-1774714041111.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3857745,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5249/8725249/interior_dashboard-1774714119289.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2606304,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5249/8725249/instrument_cluster-1774714120266.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a6a634-36f4-52a8-8072-7b24fd70e375/42a6a634-36f4-52a8-8072-7b24fd70e375_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3713620,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5249/8725249/interior_boot-1774714088089.jpg',
'Width': 4032}],
'price': 5839,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka X Elite Turbo Auto',
'transmission': 'automatic',
'trim': 'X Elite Turbo Auto',
'vin': 'W0LJD7E88HB008717',
'year': 2016}
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278725249%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [motorway.uk] INFO: Saving data for 8725249: {'created_time': 1774815525.535703, 'last_price_update_time': 1774815525.535712, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8725249') HTTP/1.1" 204 0
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd8490>
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_rear_passenger-1774701488326.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_passenger-1774701488326.jpg saved to cache
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9fcd0>
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_front_driver-1774701463854.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_driver-1774701463854.jpg saved to cache
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_rear_driver-1774543605111.jpg> (referer: None)
2026-03-29 20:18:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_passenger-1774701505108.jpg> (referer: None)
2026-03-29 20:18:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_driver-1774701560125.jpg> (referer: None)
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07e950>
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_rear_driver-1774543605111.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_rear_driver-1774543605111.jpg saved to cache
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24e810>
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_front_passenger-1774701505108.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_passenger-1774701505108.jpg saved to cache
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d249f10>
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7634%252F20487634%252Fexterior_rear_driver-1774701560125.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_driver-1774701560125.jpg saved to cache
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce652a63-134c-582a-862a-cb586cc86f1f
2026-03-29 20:18:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce652a63-134c-582a-862a-cb586cc86f1f, skipping ID generation
2026-03-29 20:18:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce652a63-134c-582a-862a-cb586cc86f1f with scrape type 1
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce652a63-134c-582a-862a-cb586cc86f1f sending to next pipeline
2026-03-29 20:18:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ce652a63-134c-582a-862a-cb586cc86f1f, identifier: 20487634
2026-03-29 20:18:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ce652a63-134c-582a-862a-cb586cc86f1f with identifier: 20487634
2026-03-29 20:18:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ce652a63-134c-582a-862a-cb586cc86f1f with identifier: 20487634
2026-03-29 20:18:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ce652a63-134c-582a-862a-cb586cc86f1f with identifier: 20487634 to the API
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_driver-1774701560125.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ce652a63-134c-582a-862a-cb586cc86f1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM25 CBO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487634',
'listing': 'auction',
'location': 'Midlothian Bonnyrigg',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 7757,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424028,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_driver-1774701463854.jpg',
'Width': 2995},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650627,
'Height': 2484,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_driver-1774701560125.jpg',
'Width': 3312},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1383577,
'Height': 2288,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_front_passenger-1774701505108.jpg',
'Width': 3050},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1830526,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7634/20487634/exterior_rear_passenger-1774701488326.jpg',
'Width': 3191},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3349325,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7634/20487634/interior_front_seats-1774701898591.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3236613,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7634/20487634/interior_rear_seats-1774701899765.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2356996,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7634/20487634/interior_dashboard-1774704194390.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7634/20487634/instrument_cluster-1774701937614.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3343124,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7634/20487634/interior_boot-1774701896163.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce652a63-134c-582a-862a-cb586cc86f1f/ce652a63-134c-582a-862a-cb586cc86f1f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1024895,
'Height': 2022,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7634/20487634/wheels_front_driver-1774701603111.jpg',
'Width': 2696}],
'price': 35925,
'price_includes_vat': False,
'registration_date': '2025-04-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport DYN SE D MHEV A',
'transmission': 'automatic',
'trim': 'Sport DYN SE D MHEV A',
'vin': 'SALCA2AN0SH365727',
'year': 2025}
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487634%27 HTTP/1.1" 200 None
2026-03-29 20:18:46 [motorway.uk] INFO: Saving data for 20487634: {'created_time': 1774815526.660814, 'last_price_update_time': 1774815526.660826, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487634') HTTP/1.1" 204 0
2026-03-29 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_driver-1774543595137.jpg> (referer: None)
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef62d0>
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8323%252F20098323%252Fexterior_front_driver-1774543595137.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_driver-1774543595137.jpg saved to cache
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328
2026-03-29 20:18:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328, skipping ID generation
2026-03-29 20:18:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 with scrape type 1
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 sending to next pipeline
2026-03-29 20:18:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328, identifier: 20098323
2026-03-29 20:18:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 with identifier: 20098323
2026-03-29 20:18:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 with identifier: 20098323
2026-03-29 20:18:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1b2ecf1f-c5df-5d0e-a94b-3a79f320b328 with identifier: 20098323 to the API
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_driver-1774543595137.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1b2ecf1f-c5df-5d0e-a94b-3a79f320b328',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SG69 JYX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20098323',
'listing': 'auction',
'location': 'West Yorkshire Ilkley',
'make': 'Ford',
'model': 'Tourneo',
'odometer': 25000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1744488,
'Height': 2380,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_driver-1774543595137.jpg',
'Width': 3173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1138381,
'Height': 2299,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_rear_driver-1774543605111.jpg',
'Width': 3065},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1183953,
'Height': 2272,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8323/20098323/exterior_front_passenger-1774543633993.jpg',
'Width': 3029},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1874201,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8323/20098323/interior_dashboard-1774544062536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b2ecf1f-c5df-5d0e-a94b-3a79f320b328/1b2ecf1f-c5df-5d0e-a94b-3a79f320b328_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2893594,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8323/20098323/instrument_cluster-1774544067539.jpg',
'Width': 4032}],
'price': 14382,
'price_includes_vat': False,
'registration_date': '2019-09-03',
'seats_number': None,
'seller_name': None,
'title': 'Ford Tourneo Connect GR Tnium Tdcia',
'transmission': 'automatic',
'trim': 'Connect GR Tnium Tdcia',
'vin': 'WF0UXXWPGUKS18361',
'year': 2019}
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720098323%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [motorway.uk] INFO: Saving data for 20098323: {'created_time': 1774815527.35399, 'last_price_update_time': 1774815527.354001, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20098323') HTTP/1.1" 204 0
2026-03-29 20:18:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20370017.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81524c4-75eb-580e-8883-288595b79562 with identifier: 20370017
2026-03-29 20:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81524c4-75eb-580e-8883-288595b79562 with scrape type 1
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_front_driver-1774778951662.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_driver-1774778951662.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_rear_driver-1774778985906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_driver-1774778985906.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_front_passenger-1774779018011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_passenger-1774779018011.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_rear_passenger-1774779024862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_passenger-1774779024862.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0017%252F20370017%252Finterior_front_seats-1774779485346.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0017/20370017/interior_front_seats-1774779485346.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0017%252F20370017%252Finterior_rear_seats-1774779600368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0017/20370017/interior_rear_seats-1774779600368.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0017%252F20370017%252Finterior_dashboard-1774791115114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0017/20370017/interior_dashboard-1774791115114.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Finstrument_cluster-1774779587339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/instrument_cluster-1774779587339.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0017%252F20370017%252Finterior_boot-1774791096484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0017/20370017/interior_boot-1774791096484.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0017%252F20370017%252Fdocs_service_history-1774781250759.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6290555b6eea5dfc183d5fde93116538%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0017/20370017/docs_service_history-1774781250759.jpg?ixlib=js-3.8.0&auto=format&s=6290555b6eea5dfc183d5fde93116538 not downloaded yet
2026-03-29 20:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_driver-1774629839060.jpeg> (referer: None)
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e066c90>
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_rear_driver-1774629839060.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_driver-1774629839060.jpeg saved to cache
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0017/20370017/docs_service_history-1774781250759.jpg?ixlib=js-3.8.0&auto=format&s=6290555b6eea5dfc183d5fde93116538> (referer: None)
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e067910>
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0017%252F20370017%252Fdocs_service_history-1774781250759.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6290555b6eea5dfc183d5fde93116538') HTTP/1.1" 204 0
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0017/20370017/docs_service_history-1774781250759.jpg?ixlib=js-3.8.0&auto=format&s=6290555b6eea5dfc183d5fde93116538 saved to cache
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0017/20370017/interior_boot-1774791096484.jpg> (referer: None)
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc6950>
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0017%252F20370017%252Finterior_boot-1774791096484.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0017/20370017/interior_boot-1774791096484.jpg saved to cache
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0017/20370017/instrument_cluster-1774779587339.jpg> (referer: None)
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e066910>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Finstrument_cluster-1774779587339.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/instrument_cluster-1774779587339.jpg saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0017/20370017/interior_dashboard-1774791115114.jpg> (referer: None)
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca22910>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0017%252F20370017%252Finterior_dashboard-1774791115114.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0017/20370017/interior_dashboard-1774791115114.jpg saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0017/20370017/interior_rear_seats-1774779600368.jpg> (referer: None)
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d9910>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0017%252F20370017%252Finterior_rear_seats-1774779600368.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0017/20370017/interior_rear_seats-1774779600368.jpg saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0017/20370017/interior_front_seats-1774779485346.jpg> (referer: None)
2026-03-29 20:18:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca20490>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0017%252F20370017%252Finterior_front_seats-1774779485346.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0017/20370017/interior_front_seats-1774779485346.jpg saved to cache
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_passenger-1774779024862.jpg> (referer: None)
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc4c90>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_rear_passenger-1774779024862.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_passenger-1774779024862.jpg saved to cache
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_passenger-1774779018011.jpg> (referer: None)
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d94d0>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_front_passenger-1774779018011.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_passenger-1774779018011.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_driver-1774778985906.jpg> (referer: None)
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca5690>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_rear_driver-1774778985906.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_driver-1774778985906.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_driver-1774778951662.jpg> (referer: None)
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca22450>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0017%252F20370017%252Fexterior_front_driver-1774778951662.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_driver-1774778951662.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e81524c4-75eb-580e-8883-288595b79562
2026-03-29 20:18:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e81524c4-75eb-580e-8883-288595b79562, skipping ID generation
2026-03-29 20:18:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81524c4-75eb-580e-8883-288595b79562 with scrape type 1
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e81524c4-75eb-580e-8883-288595b79562 sending to next pipeline
2026-03-29 20:18:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e81524c4-75eb-580e-8883-288595b79562, identifier: 20370017
2026-03-29 20:18:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e81524c4-75eb-580e-8883-288595b79562 with identifier: 20370017
2026-03-29 20:18:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e81524c4-75eb-580e-8883-288595b79562 with identifier: 20370017
2026-03-29 20:18:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e81524c4-75eb-580e-8883-288595b79562 with identifier: 20370017 to the API
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_driver-1774778951662.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e81524c4-75eb-580e-8883-288595b79562',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NL22 GZT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20370017',
'listing': 'auction',
'location': 'Wiltshire Pewsey',
'make': 'BMW',
'model': '4 Series',
'odometer': 29423,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2653652,
'Height': 2823,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_driver-1774778951662.jpg',
'Width': 3764},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2323356,
'Height': 2627,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_driver-1774778985906.jpg',
'Width': 3502},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2505017,
'Height': 2821,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_front_passenger-1774779018011.jpg',
'Width': 3761},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2070848,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0017/20370017/exterior_rear_passenger-1774779024862.jpg',
'Width': 3190},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3075180,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0017/20370017/interior_front_seats-1774779485346.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3433939,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0017/20370017/interior_rear_seats-1774779600368.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2693334,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0017/20370017/interior_dashboard-1774791115114.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1155673,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0017/20370017/instrument_cluster-1774779587339.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2485877,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0017/20370017/interior_boot-1774791096484.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e81524c4-75eb-580e-8883-288595b79562/e81524c4-75eb-580e-8883-288595b79562_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588338,
'Height': 3170,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0017/20370017/docs_service_history-1774781250759.jpg?ixlib=js-3.8.0&auto=format&s=6290555b6eea5dfc183d5fde93116538',
'Width': 1332}],
'price': 26981,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': None,
'seller_name': None,
'title': 'BMW 420I M Sport Auto',
'transmission': 'automatic',
'trim': '420I M Sport Auto',
'vin': 'WBA12AT040CJ76853',
'year': 2022}
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720370017%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [motorway.uk] INFO: Saving data for 20370017: {'created_time': 1774815534.354797, 'last_price_update_time': 1774815534.354809, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20370017') HTTP/1.1" 204 0
2026-03-29 20:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_rear_driver-1774700837503.jpg> (referer: None)
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d031e10>
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Fexterior_rear_driver-1774700837503.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_rear_driver-1774700837503.jpg saved to cache
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93
2026-03-29 20:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18237479.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501835ae-ed1b-5658-9612-26c1158f8988 with identifier: 18237479
2026-03-29 20:18:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501835ae-ed1b-5658-9612-26c1158f8988 with scrape type 1
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Fexterior_front_driver-1774542476425.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_driver-1774542476425.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Fexterior_rear_driver-1774708345841.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_rear_driver-1774708345841.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Fexterior_front_passenger-1774542695305.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_passenger-1774542695305.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7479%252F18237479%252F18237479-exterior_rear_passenger-modified-1774711783467.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7479/18237479/18237479-exterior_rear_passenger-modified-1774711783467.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F18237479%252Finterior_front_seats-1774708405554.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/18237479/interior_front_seats-1774708405554.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F18237479%252Finterior_rear_seats-1774710432375.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/18237479/interior_rear_seats-1774710432375.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F18237479%252Finterior_dashboard-1761924456737.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/18237479/interior_dashboard-1761924456737.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Finstrument_cluster-1774711772751.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/instrument_cluster-1774711772751.jpeg not downloaded yet
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7479%252F18237479%252F18237479-interior_boot-modified-1774711879628.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7479/18237479/18237479-interior_boot-modified-1774711879628.jpeg not downloaded yet
2026-03-29 20:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_front_driver-1774629401167.jpeg> (referer: None)
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7479%252F18237479%252F18237479-docs_service_history-modified-1774712007299.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df50653876eb1f9e0481bfdad0aebc83e%27 HTTP/1.1" 200 None
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7479/18237479/18237479-docs_service_history-modified-1774712007299.jpeg?ixlib=js-3.8.0&auto=format&s=f50653876eb1f9e0481bfdad0aebc83e not downloaded yet
2026-03-29 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6977/20496977/instrument_cluster-1774774420259.jpg> (referer: None)
2026-03-29 20:18:55 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17276360) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/7479/18237479/instrument_cluster-1774711772751.jpeg>.
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d131290>
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F19657268%252Fexterior_front_driver-1774629401167.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_front_driver-1774629401167.jpeg saved to cache
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f86745c7-c61f-5400-a5e8-94c8fc922fb7
2026-03-29 20:18:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f86745c7-c61f-5400-a5e8-94c8fc922fb7, skipping ID generation
2026-03-29 20:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 with scrape type 1
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f86745c7-c61f-5400-a5e8-94c8fc922fb7 sending to next pipeline
2026-03-29 20:18:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f86745c7-c61f-5400-a5e8-94c8fc922fb7, identifier: 19657268
2026-03-29 20:18:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f86745c7-c61f-5400-a5e8-94c8fc922fb7 with identifier: 19657268
2026-03-29 20:18:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f86745c7-c61f-5400-a5e8-94c8fc922fb7 with identifier: 19657268
2026-03-29 20:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f86745c7-c61f-5400-a5e8-94c8fc922fb7 with identifier: 19657268 to the API
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_front_driver-1774629401167.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'f86745c7-c61f-5400-a5e8-94c8fc922fb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'RJ23 NRU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19657268',
'listing': 'auction',
'location': 'Hampshire Basingstoke',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 17500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1431138,
'Height': 2299,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_front_driver-1774629401167.jpeg',
'Width': 3065},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2384542,
'Height': 2817,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_driver-1774629839060.jpeg',
'Width': 3756},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2061424,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/19657268/exterior_rear_passenger-1774629831866.jpeg',
'Width': 3526},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1143276,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/19657268/instrument_cluster-1774630081211.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86745c7-c61f-5400-a5e8-94c8fc922fb7/f86745c7-c61f-5400-a5e8-94c8fc922fb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456580,
'Height': 1364,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/19657268/wheels_front_driver-1774630087662.jpeg',
'Width': 1819}],
'price': 34979,
'price_includes_vat': False,
'registration_date': '2023-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Defender Hard TOP D MHEV Auto',
'transmission': 'automatic',
'trim': 'Hard TOP D MHEV Auto',
'vin': 'SALEACAW0R2246340',
'year': 2023}
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719657268%27 HTTP/1.1" 200 None
2026-03-29 20:18:55 [motorway.uk] INFO: Saving data for 19657268: {'created_time': 1774815535.661622, 'last_price_update_time': 1774815535.661635, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19657268') HTTP/1.1" 204 0
2026-03-29 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7479/18237479/18237479-docs_service_history-modified-1774712007299.jpeg?ixlib=js-3.8.0&auto=format&s=f50653876eb1f9e0481bfdad0aebc83e> (referer: None)
2026-03-29 20:18:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e073510>
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Finstrument_cluster-1774774420259.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/instrument_cluster-1774774420259.jpg saved to cache
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fc350>
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7479%252F18237479%252F18237479-docs_service_history-modified-1774712007299.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df50653876eb1f9e0481bfdad0aebc83e') HTTP/1.1" 204 0
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7479/18237479/18237479-docs_service_history-modified-1774712007299.jpeg?ixlib=js-3.8.0&auto=format&s=f50653876eb1f9e0481bfdad0aebc83e saved to cache
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7479/18237479/18237479-interior_boot-modified-1774711879628.jpeg> (referer: None)
2026-03-29 20:18:56 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/7479/18237479/instrument_cluster-1774711772751.jpeg>.
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd9390>
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7479%252F18237479%252F18237479-interior_boot-modified-1774711879628.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7479/18237479/18237479-interior_boot-modified-1774711879628.jpeg saved to cache
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:56 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17692897) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/18237479/interior_dashboard-1761924456737.jpeg>.
2026-03-29 20:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/18237479/instrument_cluster-1774711772751.jpeg> (referer: None)
2026-03-29 20:18:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\x03\x08x\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x95P\x01\x02\xfe\x8c\x00\x00\x00\x00'
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d506bd0>
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Finstrument_cluster-1774711772751.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/instrument_cluster-1774711772751.jpeg saved to cache
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:56 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (19797550) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/18237479/interior_rear_seats-1774710432375.jpeg>.
2026-03-29 20:18:56 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/18237479/interior_dashboard-1761924456737.jpeg>.
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7479/18237479/interior_dashboard-1761924456737.jpeg> (referer: None)
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\x05\xd3t\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08%m\x01\x05\xc9\x88\x00\x00\x00\x00'
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13e110>
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F18237479%252Finterior_dashboard-1761924456737.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/18237479/interior_dashboard-1761924456737.jpeg saved to cache
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:57 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16455520) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/18237479/interior_front_seats-1774708405554.jpeg>.
2026-03-29 20:18:57 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/18237479/interior_rear_seats-1774710432375.jpeg>.
2026-03-29 20:18:58 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7479/18237479/interior_front_seats-1774708405554.jpeg>.
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7479/18237479/interior_front_seats-1774708405554.jpeg> (referer: None)
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7479/18237479/interior_rear_seats-1774710432375.jpeg> (referer: None)
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xf3\x12z\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x04\xe6\x00\xf3\x08\x8e\x00\x00\x00\x00'
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24fa10>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F18237479%252Finterior_front_seats-1774708405554.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/18237479/interior_front_seats-1774708405554.jpeg saved to cache
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01&e\xf9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xb05\x01&\\\r\x00\x00\x00\x00'
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdb750>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7479%252F18237479%252Finterior_rear_seats-1774710432375.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7479/18237479/interior_rear_seats-1774710432375.jpeg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7479/18237479/18237479-exterior_rear_passenger-modified-1774711783467.jpeg> (referer: None)
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_passenger-1774542695305.jpeg> (referer: None)
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24c7d0>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7479%252F18237479%252F18237479-exterior_rear_passenger-modified-1774711783467.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7479/18237479/18237479-exterior_rear_passenger-modified-1774711783467.jpeg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea86190>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Fexterior_front_passenger-1774542695305.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_passenger-1774542695305.jpeg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_driver-1774542476425.jpeg> (referer: None)
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec05b90>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Fexterior_front_driver-1774542476425.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_driver-1774542476425.jpeg saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_front_driver-1774700820014.jpg> (referer: None)
2026-03-29 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_rear_driver-1774708345841.jpeg> (referer: None)
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021490>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7361%252F20487361%252Fexterior_front_driver-1774700820014.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_front_driver-1774700820014.jpg saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93
2026-03-29 20:19:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6ac2bae-307c-51ca-8d47-a7e0dd415c93, skipping ID generation
2026-03-29 20:19:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 with scrape type 1
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6ac2bae-307c-51ca-8d47-a7e0dd415c93 sending to next pipeline
2026-03-29 20:19:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e6ac2bae-307c-51ca-8d47-a7e0dd415c93, identifier: 20487361
2026-03-29 20:19:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e6ac2bae-307c-51ca-8d47-a7e0dd415c93 with identifier: 20487361
2026-03-29 20:19:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e6ac2bae-307c-51ca-8d47-a7e0dd415c93 with identifier: 20487361
2026-03-29 20:19:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e6ac2bae-307c-51ca-8d47-a7e0dd415c93 with identifier: 20487361 to the API
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_front_driver-1774700820014.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e6ac2bae-307c-51ca-8d47-a7e0dd415c93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FE16 CFP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487361',
'listing': 'auction',
'location': 'Buckinghamshire High Wycombe',
'make': 'Ford',
'model': 'Focus',
'odometer': 44000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1835724,
'Height': 2805,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_front_driver-1774700820014.jpg',
'Width': 3740},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1761565,
'Height': 3006,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7361/20487361/exterior_rear_driver-1774700837503.jpg',
'Width': 4008},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2807250,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7361/20487361/interior_front_seats-1774701167663.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2518127,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7361/20487361/instrument_cluster-1774701282398.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6ac2bae-307c-51ca-8d47-a7e0dd415c93/e6ac2bae-307c-51ca-8d47-a7e0dd415c93_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3534123,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7361/20487361/interior_boot-1774701258013.jpg',
'Width': 4032}],
'price': 11033,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST-3 TDCI',
'transmission': 'manual',
'trim': 'ST-3 TDCI',
'vin': 'WF05XXGCC5GG26652',
'year': 2016}
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487361%27 HTTP/1.1" 200 None
2026-03-29 20:19:00 [motorway.uk] INFO: Saving data for 20487361: {'created_time': 1774815540.903799, 'last_price_update_time': 1774815540.903809, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487361') HTTP/1.1" 204 0
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d505410>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7479%252F18237479%252Fexterior_rear_driver-1774708345841.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_rear_driver-1774708345841.jpeg saved to cache
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 501835ae-ed1b-5658-9612-26c1158f8988
2026-03-29 20:19:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 501835ae-ed1b-5658-9612-26c1158f8988, skipping ID generation
2026-03-29 20:19:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501835ae-ed1b-5658-9612-26c1158f8988 with scrape type 1
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 501835ae-ed1b-5658-9612-26c1158f8988 sending to next pipeline
2026-03-29 20:19:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 501835ae-ed1b-5658-9612-26c1158f8988, identifier: 18237479
2026-03-29 20:19:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 501835ae-ed1b-5658-9612-26c1158f8988 with identifier: 18237479
2026-03-29 20:19:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 501835ae-ed1b-5658-9612-26c1158f8988 with identifier: 18237479
2026-03-29 20:19:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 501835ae-ed1b-5658-9612-26c1158f8988 with identifier: 18237479 to the API
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_rear_driver-1774708345841.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '501835ae-ed1b-5658-9612-26c1158f8988',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FL10 NTU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18237479',
'listing': 'auction',
'location': 'Hertfordshire Berkhamsted',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 101157,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4998271,
'Height': 4925,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_driver-1774542476425.jpeg',
'Width': 6567},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7463084,
'Height': 5880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_rear_driver-1774708345841.jpeg',
'Width': 7840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2222560,
'Height': 3365,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/18237479/exterior_front_passenger-1774542695305.jpeg',
'Width': 4486},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5706365,
'Height': 4509,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7479/18237479/18237479-exterior_rear_passenger-modified-1774711783467.jpeg',
'Width': 6012},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16455520,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/7479/18237479/interior_front_seats-1774708405554.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 19797550,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/7479/18237479/interior_rear_seats-1774710432375.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 17692897,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/7479/18237479/interior_dashboard-1761924456737.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 17276360,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7479/18237479/instrument_cluster-1774711772751.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10292712,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7479/18237479/18237479-interior_boot-modified-1774711879628.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501835ae-ed1b-5658-9612-26c1158f8988/501835ae-ed1b-5658-9612-26c1158f8988_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123729,
'Height': 1024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7479/18237479/18237479-docs_service_history-modified-1774712007299.jpeg?ixlib=js-3.8.0&auto=format&s=f50653876eb1f9e0481bfdad0aebc83e',
'Width': 768}],
'price': 20865,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Defender 90 XS SW SWB',
'transmission': 'manual',
'trim': '90 XS SW SWB',
'vin': 'SALLDVBS7AA795877',
'year': 2010}
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718237479%27 HTTP/1.1" 200 None
2026-03-29 20:19:01 [motorway.uk] INFO: Saving data for 18237479: {'created_time': 1774815541.64791, 'last_price_update_time': 1774815541.647921, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18237479') HTTP/1.1" 204 0
2026-03-29 20:19:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6977/20496977/interior_dashboard-1774775494561.jpg> (referer: None)
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf6c50>
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6977%252F20496977%252Finterior_dashboard-1774775494561.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6977/20496977/interior_dashboard-1774775494561.jpg saved to cache
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6977/20496977/interior_rear_seats-1774774341001.jpg> (referer: None)
2026-03-29 20:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6977/20496977/interior_front_seats-1774774327560.jpg> (referer: None)
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07fd50>
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6977%252F20496977%252Finterior_rear_seats-1774774341001.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6977/20496977/interior_rear_seats-1774774341001.jpg saved to cache
2026-03-29 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d130550>
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6977%252F20496977%252Finterior_front_seats-1774774327560.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6977/20496977/interior_front_seats-1774774327560.jpg saved to cache
2026-03-29 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_passenger-1774773781884.jpg> (referer: None)
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c404f90>
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_front_passenger-1774773781884.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_passenger-1774773781884.jpg saved to cache
2026-03-29 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:19:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_driver-1774773714854.jpg> (referer: None)
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e070850>
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6977%252F20496977%252Fexterior_front_driver-1774773714854.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_driver-1774773714854.jpg saved to cache
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7267eea1-fa38-5f52-b069-269a46f5babb
2026-03-29 20:19:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7267eea1-fa38-5f52-b069-269a46f5babb, skipping ID generation
2026-03-29 20:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7267eea1-fa38-5f52-b069-269a46f5babb with scrape type 1
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7267eea1-fa38-5f52-b069-269a46f5babb sending to next pipeline
2026-03-29 20:19:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7267eea1-fa38-5f52-b069-269a46f5babb, identifier: 20496977
2026-03-29 20:19:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7267eea1-fa38-5f52-b069-269a46f5babb with identifier: 20496977
2026-03-29 20:19:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7267eea1-fa38-5f52-b069-269a46f5babb with identifier: 20496977
2026-03-29 20:19:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7267eea1-fa38-5f52-b069-269a46f5babb with identifier: 20496977 to the API
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_driver-1774773714854.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7267eea1-fa38-5f52-b069-269a46f5babb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M121 SMW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20496977',
'listing': 'auction',
'location': 'Buckinghamshire Gerrards Cross',
'make': 'Peugeot',
'model': '3008',
'odometer': 59330,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1843857,
'Height': 2184,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_driver-1774773714854.jpg',
'Width': 2912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1103419,
'Height': 1830,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_driver-1774773733899.jpg',
'Width': 2440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1471959,
'Height': 2216,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_front_passenger-1774773781884.jpg',
'Width': 2954},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 946433,
'Height': 1817,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6977/20496977/exterior_rear_passenger-1774773775696.jpg',
'Width': 2422},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4271987,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6977/20496977/interior_front_seats-1774774327560.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4452490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6977/20496977/interior_rear_seats-1774774341001.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3008225,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6977/20496977/interior_dashboard-1774775494561.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7267eea1-fa38-5f52-b069-269a46f5babb/7267eea1-fa38-5f52-b069-269a46f5babb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3062581,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6977/20496977/instrument_cluster-1774774420259.jpg',
'Width': 4032}],
'price': 8934,
'price_includes_vat': False,
'registration_date': '2017-12-06',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 Allure BlueHDi S/S Auto',
'transmission': 'automatic',
'trim': 'Allure BlueHDi S/S Auto',
'vin': 'VF3MCBHZWHS333688',
'year': 2017}
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496977%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [motorway.uk] INFO: Saving data for 20496977: {'created_time': 1774815543.656284, 'last_price_update_time': 1774815543.656293, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20496977') HTTP/1.1" 204 0
2026-03-29 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633430520.jpg?ixlib=js-3.8.0&auto=format&s=5ffb8fc7893eb73c7abe9f438fcab0a2> (referer: None)
2026-03-29 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0005/20490005/interior_boot-1774710891555.jpg> (referer: None)
2026-03-29 20:19:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e070250>
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0205%252F19110205%252Fdocs_service_history-1774633430520.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ffb8fc7893eb73c7abe9f438fcab0a2') HTTP/1.1" 204 0
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633430520.jpg?ixlib=js-3.8.0&auto=format&s=5ffb8fc7893eb73c7abe9f438fcab0a2 saved to cache
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1d50>
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0005%252F20490005%252Finterior_boot-1774710891555.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0005/20490005/interior_boot-1774710891555.jpg saved to cache
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633428564.jpg?ixlib=js-3.8.0&auto=format&s=a3dab1d0e71dd4c1f9845cedf9ee489e> (referer: None)
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d772510>
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0205%252F19110205%252Fdocs_service_history-1774633428564.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3dab1d0e71dd4c1f9845cedf9ee489e') HTTP/1.1" 204 0
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633428564.jpg?ixlib=js-3.8.0&auto=format&s=a3dab1d0e71dd4c1f9845cedf9ee489e saved to cache
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0005/20490005/instrument_cluster-1774710957633.jpg> (referer: None)
2026-03-29 20:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459015.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0205/19110205/interior_boot-1774633010279.jpg> (referer: None)
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d118250>
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Finstrument_cluster-1774710957633.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/instrument_cluster-1774710957633.jpg saved to cache
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90d38397-2068-5b31-b8f0-7a98a4ac94aa with identifier: 20459015
2026-03-29 20:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90d38397-2068-5b31-b8f0-7a98a4ac94aa with scrape type 2
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90d38397-2068-5b31-b8f0-7a98a4ac94aa with scrape type 2
2026-03-29 20:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 90d38397-2068-5b31-b8f0-7a98a4ac94aa, identifier: 20459015
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbde7d0>
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0205%252F19110205%252Finterior_boot-1774633010279.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0205/19110205/interior_boot-1774633010279.jpg saved to cache
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 90d38397-2068-5b31-b8f0-7a98a4ac94aa with identifier: 20459015
2026-03-29 20:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 90d38397-2068-5b31-b8f0-7a98a4ac94aa with identifier: 20459015
2026-03-29 20:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 90d38397-2068-5b31-b8f0-7a98a4ac94aa with identifier: 20459015 to the API
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459015.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '90d38397-2068-5b31-b8f0-7a98a4ac94aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NC73 XPD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20459015',
'listing': 'auction',
'location': 'County Durham Durham',
'make': 'Porsche',
'model': 'Macan',
'odometer': 18768,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 41648,
'price_includes_vat': False,
'registration_date': '2023-10-30',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S-A',
'transmission': 'automatic',
'trim': 'S-A',
'vin': 'WP1ZZZ950RLB02330',
'year': 2023}
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459015%27 HTTP/1.1" 200 None
2026-03-29 20:19:05 [motorway.uk] INFO: Saving data for 20459015: {'auction_closing_time': 1774884600.0, 'created_time': 1774728969.534544, 'last_price_update_time': 1774815545.411266}
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20459015') HTTP/1.1" 204 0
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0205/19110205/instrument_cluster-1774632880727.jpg> (referer: None)
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0005/20490005/interior_dashboard-1774710938981.jpg> (referer: None)
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0005/20490005/interior_rear_seats-1774710889409.jpg> (referer: None)
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16d310>
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0205%252F19110205%252Finstrument_cluster-1774632880727.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0205/19110205/instrument_cluster-1774632880727.jpg saved to cache
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef6a90>
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Finterior_dashboard-1774710938981.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/interior_dashboard-1774710938981.jpg saved to cache
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae4890>
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0005%252F20490005%252Finterior_rear_seats-1774710889409.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0005/20490005/interior_rear_seats-1774710889409.jpg saved to cache
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:05 [scrapy.extensions.logstats] INFO: Crawled 111 pages (at 15 pages/min), scraped 89 items (at 27 items/min)
2026-03-29 20:19:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0205/19110205/interior_dashboard-1774634130950.jpg> (referer: None)
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0005/20490005/interior_front_seats-1774710894152.jpg> (referer: None)
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0205/19110205/exterior_rear_passenger-1774633956180.jpg> (referer: None)
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e090e10>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0205%252F19110205%252Finterior_dashboard-1774634130950.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0205/19110205/interior_dashboard-1774634130950.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3c9d0>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0005%252F20490005%252Finterior_front_seats-1774710894152.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0005/20490005/interior_front_seats-1774710894152.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d032290>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0205%252F19110205%252Fexterior_rear_passenger-1774633956180.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0205/19110205/exterior_rear_passenger-1774633956180.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_passenger-1774709697559.jpg> (referer: None)
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0205/19110205/interior_front_seats-1774632628901.jpg> (referer: None)
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9d610>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_rear_passenger-1774709697559.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_passenger-1774709697559.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2489d0>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0205%252F19110205%252Finterior_front_seats-1774632628901.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0205/19110205/interior_front_seats-1774632628901.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_driver-1774709691084.jpg> (referer: None)
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_rear_driver-1774632337910.jpg> (referer: None)
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9dad0>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_rear_driver-1774709691084.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_driver-1774709691084.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd49d0>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0205%252F19110205%252Fexterior_rear_driver-1774632337910.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_rear_driver-1774632337910.jpg saved to cache
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_driver-1774709759875.jpg> (referer: None)
2026-03-29 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_front_driver-1774632360079.jpg> (referer: None)
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3e190>
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0005%252F20490005%252Fexterior_front_driver-1774709759875.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_driver-1774709759875.jpg saved to cache
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 532a6416-7876-50d7-a49e-45c2b515063c
2026-03-29 20:19:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 532a6416-7876-50d7-a49e-45c2b515063c, skipping ID generation
2026-03-29 20:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532a6416-7876-50d7-a49e-45c2b515063c with scrape type 1
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 532a6416-7876-50d7-a49e-45c2b515063c sending to next pipeline
2026-03-29 20:19:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 532a6416-7876-50d7-a49e-45c2b515063c, identifier: 20490005
2026-03-29 20:19:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 532a6416-7876-50d7-a49e-45c2b515063c with identifier: 20490005
2026-03-29 20:19:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 532a6416-7876-50d7-a49e-45c2b515063c with identifier: 20490005
2026-03-29 20:19:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 532a6416-7876-50d7-a49e-45c2b515063c with identifier: 20490005 to the API
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_driver-1774709759875.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '532a6416-7876-50d7-a49e-45c2b515063c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YV18 ATU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490005',
'listing': 'auction',
'location': 'Derbyshire Chesterfield',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 87000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1622630,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_driver-1774709759875.jpg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1019382,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_driver-1774709691084.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1621355,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_front_passenger-1774709695368.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1960475,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0005/20490005/exterior_rear_passenger-1774709697559.jpg',
'Width': 3599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2368303,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0005/20490005/interior_front_seats-1774710894152.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2862729,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0005/20490005/interior_rear_seats-1774710889409.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2425154,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0005/20490005/interior_dashboard-1774710938981.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1680765,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0005/20490005/instrument_cluster-1774710957633.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532a6416-7876-50d7-a49e-45c2b515063c/532a6416-7876-50d7-a49e-45c2b515063c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2179408,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0005/20490005/interior_boot-1774710891555.jpg',
'Width': 3840}],
'price': 8208,
'price_includes_vat': False,
'registration_date': '2018-07-19',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Beetle Design TDI Bmotion Tech',
'transmission': 'manual',
'trim': 'Design TDI Bmotion Tech',
'vin': 'WVWZZZ16ZJM511887',
'year': 2018}
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490005%27 HTTP/1.1" 200 None
2026-03-29 20:19:07 [motorway.uk] INFO: Saving data for 20490005: {'created_time': 1774815547.76954, 'last_price_update_time': 1774815547.76955, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490005') HTTP/1.1" 204 0
2026-03-29 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469913.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd4090>
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0205%252F19110205%252Fexterior_front_driver-1774632360079.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_front_driver-1774632360079.jpg saved to cache
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9
2026-03-29 20:19:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1bd4d08-aecc-50b1-81fd-3475ae89dff9, skipping ID generation
2026-03-29 20:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9 with scrape type 1
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1bd4d08-aecc-50b1-81fd-3475ae89dff9 sending to next pipeline
2026-03-29 20:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f1bd4d08-aecc-50b1-81fd-3475ae89dff9, identifier: 19110205
2026-03-29 20:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f1bd4d08-aecc-50b1-81fd-3475ae89dff9 with identifier: 19110205
2026-03-29 20:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f1bd4d08-aecc-50b1-81fd-3475ae89dff9 with identifier: 19110205
2026-03-29 20:19:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f1bd4d08-aecc-50b1-81fd-3475ae89dff9 with identifier: 19110205 to the API
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_front_driver-1774632360079.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f1bd4d08-aecc-50b1-81fd-3475ae89dff9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE67 OAV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19110205',
'listing': 'auction',
'location': 'West Midlands Solihull',
'make': 'Mercedes',
'model': 'SLC',
'odometer': 54004,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1737751,
'Height': 2510,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_front_driver-1774632360079.jpg',
'Width': 3346},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771603,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0205/19110205/exterior_rear_driver-1774632337910.jpg',
'Width': 3390},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1943133,
'Height': 2380,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0205/19110205/exterior_rear_passenger-1774633956180.jpg',
'Width': 3173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3668733,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0205/19110205/interior_front_seats-1774632628901.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2385778,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0205/19110205/interior_dashboard-1774634130950.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2241822,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0205/19110205/instrument_cluster-1774632880727.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3733285,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0205/19110205/interior_boot-1774633010279.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3156071,
'Height': 3387,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633428564.jpg?ixlib=js-3.8.0&auto=format&s=a3dab1d0e71dd4c1f9845cedf9ee489e',
'Width': 2291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1bd4d08-aecc-50b1-81fd-3475ae89dff9/f1bd4d08-aecc-50b1-81fd-3475ae89dff9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2858873,
'Height': 2977,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0205/19110205/docs_service_history-1774633430520.jpg?ixlib=js-3.8.0&auto=format&s=5ffb8fc7893eb73c7abe9f438fcab0a2',
'Width': 2177}],
'price': 14184,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes SLC 200 AMG Line Auto',
'transmission': 'automatic',
'trim': '200 AMG Line Auto',
'vin': 'WDD1724342F148216',
'year': 2017}
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719110205%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [motorway.uk] INFO: Saving data for 19110205: {'created_time': 1774815548.399988, 'last_price_update_time': 1774815548.399998, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19110205') HTTP/1.1" 204 0
2026-03-29 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7257/20487257/interior_dashboard-1774703315843.jpg> (referer: None)
2026-03-29 20:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d1b046-f1fe-5cc0-aa14-3090c35650e4 with identifier: 20469913
2026-03-29 20:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4 with scrape type 1
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_front_driver-1774613019003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_driver-1774613019003.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_rear_driver-1774613047219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_driver-1774613047219.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_front_passenger-1774613110435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_passenger-1774613110435.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_rear_passenger-1774613071404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_passenger-1774613071404.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9913%252F20469913%252Finterior_front_seats-1774613719657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9913/20469913/interior_front_seats-1774613719657.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9913%252F20469913%252Finterior_rear_seats-1774613898070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9913/20469913/interior_rear_seats-1774613898070.jpg not downloaded yet
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07410>
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Finterior_dashboard-1774703315843.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/interior_dashboard-1774703315843.jpg saved to cache
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9913%252F20469913%252Finterior_dashboard-1774614899226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9913/20469913/interior_dashboard-1774614899226.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Finstrument_cluster-1774613792774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/instrument_cluster-1774613792774.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9913%252F20469913%252Finterior_boot-1774614045430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9913/20469913/interior_boot-1774614045430.jpg not downloaded yet
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9913%252F20469913%252Fdocs_service_history-1774614374485.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da678e495b31e67606619f421e1d59cc1%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9913/20469913/docs_service_history-1774614374485.jpg?ixlib=js-3.8.0&auto=format&s=a678e495b31e67606619f421e1d59cc1 not downloaded yet
2026-03-29 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7257/20487257/interior_rear_seats-1774703256830.jpg> (referer: None)
2026-03-29 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_driver-1774613019003.jpg> (referer: None)
2026-03-29 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_passenger-1774702309878.jpg> (referer: None)
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdf710>
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7257%252F20487257%252Finterior_rear_seats-1774703256830.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7257/20487257/interior_rear_seats-1774703256830.jpg saved to cache
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23f590>
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_front_driver-1774613019003.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_driver-1774613019003.jpg saved to cache
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6327d0>
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_rear_passenger-1774702309878.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_passenger-1774702309878.jpg saved to cache
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9913/20469913/docs_service_history-1774614374485.jpg?ixlib=js-3.8.0&auto=format&s=a678e495b31e67606619f421e1d59cc1> (referer: None)
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c48590>
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9913%252F20469913%252Fdocs_service_history-1774614374485.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da678e495b31e67606619f421e1d59cc1') HTTP/1.1" 204 0
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9913/20469913/docs_service_history-1774614374485.jpg?ixlib=js-3.8.0&auto=format&s=a678e495b31e67606619f421e1d59cc1 saved to cache
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9913/20469913/instrument_cluster-1774613792774.jpg> (referer: None)
2026-03-29 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9913/20469913/interior_dashboard-1774614899226.jpg> (referer: None)
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d0ed0>
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Finstrument_cluster-1774613792774.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/instrument_cluster-1774613792774.jpg saved to cache
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d3c50>
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9913%252F20469913%252Finterior_dashboard-1774614899226.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9913/20469913/interior_dashboard-1774614899226.jpg saved to cache
2026-03-29 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9913/20469913/interior_boot-1774614045430.jpg> (referer: None)
2026-03-29 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9913/20469913/interior_rear_seats-1774613898070.jpg> (referer: None)
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24e150>
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9913%252F20469913%252Finterior_boot-1774614045430.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9913/20469913/interior_boot-1774614045430.jpg saved to cache
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e00be90>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9913%252F20469913%252Finterior_rear_seats-1774613898070.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9913/20469913/interior_rear_seats-1774613898070.jpg saved to cache
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9913/20469913/interior_front_seats-1774613719657.jpg> (referer: None)
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c631e10>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9913%252F20469913%252Finterior_front_seats-1774613719657.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9913/20469913/interior_front_seats-1774613719657.jpg saved to cache
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_passenger-1774613071404.jpg> (referer: None)
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_passenger-1774613110435.jpg> (referer: None)
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf53d0>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_rear_passenger-1774613071404.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_passenger-1774613071404.jpg saved to cache
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_driver-1774613047219.jpg> (referer: None)
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d36d0>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_front_passenger-1774613110435.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_passenger-1774613110435.jpg saved to cache
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24de10>
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9913%252F20469913%252Fexterior_rear_driver-1774613047219.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_driver-1774613047219.jpg saved to cache
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4
2026-03-29 20:19:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34d1b046-f1fe-5cc0-aa14-3090c35650e4, skipping ID generation
2026-03-29 20:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4 with scrape type 1
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34d1b046-f1fe-5cc0-aa14-3090c35650e4 sending to next pipeline
2026-03-29 20:19:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 34d1b046-f1fe-5cc0-aa14-3090c35650e4, identifier: 20469913
2026-03-29 20:19:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 34d1b046-f1fe-5cc0-aa14-3090c35650e4 with identifier: 20469913
2026-03-29 20:19:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 34d1b046-f1fe-5cc0-aa14-3090c35650e4 with identifier: 20469913
2026-03-29 20:19:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 34d1b046-f1fe-5cc0-aa14-3090c35650e4 with identifier: 20469913 to the API
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_driver-1774613047219.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '34d1b046-f1fe-5cc0-aa14-3090c35650e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SJ21 YOP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20469913',
'listing': 'auction',
'location': 'Glasgow City Glasgow',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 58739,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2108134,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_driver-1774613019003.jpg',
'Width': 3518},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1776055,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_driver-1774613047219.jpg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2196206,
'Height': 2737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_front_passenger-1774613110435.jpg',
'Width': 3649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1751968,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9913/20469913/exterior_rear_passenger-1774613071404.jpg',
'Width': 3267},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3829843,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9913/20469913/interior_front_seats-1774613719657.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3610290,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9913/20469913/interior_rear_seats-1774613898070.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2163119,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9913/20469913/interior_dashboard-1774614899226.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2460319,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9913/20469913/instrument_cluster-1774613792774.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4698631,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9913/20469913/interior_boot-1774614045430.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d1b046-f1fe-5cc0-aa14-3090c35650e4/34d1b046-f1fe-5cc0-aa14-3090c35650e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637551,
'Height': 3114,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9913/20469913/docs_service_history-1774614374485.jpg?ixlib=js-3.8.0&auto=format&s=a678e495b31e67606619f421e1d59cc1',
'Width': 2134}],
'price': 30451,
'price_includes_vat': False,
'registration_date': '2021-03-04',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Touareg V6 Black Edition TDI A',
'transmission': 'automatic',
'trim': 'V6 Black Edition TDI A',
'vin': 'WVGZZZCRZMD024014',
'year': 2021}
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469913%27 HTTP/1.1" 200 None
2026-03-29 20:19:11 [motorway.uk] INFO: Saving data for 20469913: {'created_time': 1774815551.702002, 'last_price_update_time': 1774815551.702013, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20469913') HTTP/1.1" 204 0
2026-03-29 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_passenger-1774702330524.jpg> (referer: None)
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e073110>
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_front_passenger-1774702330524.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_passenger-1774702330524.jpg saved to cache
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:19:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_driver-1774702270879.jpg> (referer: None)
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23d290>
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_rear_driver-1774702270879.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_driver-1774702270879.jpg saved to cache
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:19:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_driver-1774702272592.jpg> (referer: None)
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d015190>
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7257%252F20487257%252Fexterior_front_driver-1774702272592.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_driver-1774702272592.jpg saved to cache
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00b9f79f-c193-5204-8c49-e7138c02d04a
2026-03-29 20:19:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00b9f79f-c193-5204-8c49-e7138c02d04a, skipping ID generation
2026-03-29 20:19:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b9f79f-c193-5204-8c49-e7138c02d04a with scrape type 1
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00b9f79f-c193-5204-8c49-e7138c02d04a sending to next pipeline
2026-03-29 20:19:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 00b9f79f-c193-5204-8c49-e7138c02d04a, identifier: 20487257
2026-03-29 20:19:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 00b9f79f-c193-5204-8c49-e7138c02d04a with identifier: 20487257
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Beige HTTP/1.1" 200 None
2026-03-29 20:19:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:19:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 00b9f79f-c193-5204-8c49-e7138c02d04a with identifier: 20487257
2026-03-29 20:19:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 00b9f79f-c193-5204-8c49-e7138c02d04a with identifier: 20487257 to the API
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_driver-1774702272592.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '00b9f79f-c193-5204-8c49-e7138c02d04a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EF68 OPD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487257',
'listing': 'auction',
'location': 'Northamptonshire Towcester',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 41418,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1966289,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_driver-1774702272592.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1592501,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_driver-1774702270879.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1654069,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_front_passenger-1774702330524.jpg',
'Width': 3446},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1896730,
'Height': 2667,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7257/20487257/exterior_rear_passenger-1774702309878.jpg',
'Width': 3556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4899212,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7257/20487257/interior_front_seats-1774703185840.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3838735,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7257/20487257/interior_rear_seats-1774703256830.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3556108,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7257/20487257/interior_dashboard-1774703315843.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505765,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7257/20487257/instrument_cluster-1774703267080.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b9f79f-c193-5204-8c49-e7138c02d04a/00b9f79f-c193-5204-8c49-e7138c02d04a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4918284,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7257/20487257/interior_boot-1774703392477.jpg',
'Width': 4032}],
'price': 9217,
'price_includes_vat': False,
'registration_date': '2018-12-20',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE TSI',
'transmission': 'manual',
'trim': 'SE TSI',
'vin': 'WVWZZZAWZKU024181',
'year': 2018}
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487257%27 HTTP/1.1" 200 None
2026-03-29 20:19:13 [motorway.uk] INFO: Saving data for 20487257: {'created_time': 1774815553.154848, 'last_price_update_time': 1774815553.154858, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487257') HTTP/1.1" 204 0
2026-03-29 20:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_passenger-1774707136590.jpg> (referer: None)
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d772410>
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_front_passenger-1774707136590.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_passenger-1774707136590.jpg saved to cache
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96553639-abb3-5226-a7a8-2c6bbb6df999
2026-03-29 20:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9918/9709918/interior_front_seats-1774785293948.jpg> (referer: None)
2026-03-29 20:19:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e072010>
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9918%252F9709918%252Finterior_front_seats-1774785293948.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9918/9709918/interior_front_seats-1774785293948.jpg saved to cache
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62
2026-03-29 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1812/20481812/interior_front_seats-1774694216788.jpg> (referer: None)
2026-03-29 20:19:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad36d0>
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1812%252F20481812%252Finterior_front_seats-1774694216788.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1812/20481812/interior_front_seats-1774694216788.jpg saved to cache
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe
2026-03-29 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5589/20485589/interior_front_seats-1774700701236.jpg> (referer: None)
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e070210>
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17ad40d-8a52-5b1f-b8ef-1e59f77bff32/e17ad40d-8a52-5b1f-b8ef-1e59f77bff32_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5589%252F20485589%252Finterior_front_seats-1774700701236.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5589/20485589/interior_front_seats-1774700701236.jpg saved to cache
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20387201.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 with identifier: 20387201
2026-03-29 20:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 with scrape type 1
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_front_driver-1774371577528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_driver-1774371577528.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_rear_driver-1774371585684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_driver-1774371585684.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_front_passenger-1774371590700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_passenger-1774371590700.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_rear_passenger-1774371593596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_passenger-1774371593596.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7201%252F20387201%252Finterior_front_seats-1774547468690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7201/20387201/interior_front_seats-1774547468690.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7201%252F20387201%252Finterior_rear_seats-1774372663610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7201/20387201/interior_rear_seats-1774372663610.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7201%252F20387201%252Finterior_dashboard-1774528412794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7201/20387201/interior_dashboard-1774528412794.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Finstrument_cluster-1774372234525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/instrument_cluster-1774372234525.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7201%252F20387201%252Finterior_boot-1774547555845.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7201/20387201/interior_boot-1774547555845.jpg not downloaded yet
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7201%252F20387201%252Fdocs_service_history-1774372068033.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d8e61b8f5560ec452b5fd8ec7905242%27 HTTP/1.1" 200 None
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7201/20387201/docs_service_history-1774372068033.jpg?ixlib=js-3.8.0&auto=format&s=0d8e61b8f5560ec452b5fd8ec7905242 not downloaded yet
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_rear_driver-1774707093261.jpg> (referer: None)
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7201/20387201/docs_service_history-1774372068033.jpg?ixlib=js-3.8.0&auto=format&s=0d8e61b8f5560ec452b5fd8ec7905242> (referer: None)
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24a6d0>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0308%252F19560308%252Fexterior_rear_driver-1774707093261.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_rear_driver-1774707093261.jpg saved to cache
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96553639-abb3-5226-a7a8-2c6bbb6df999
2026-03-29 20:19:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96553639-abb3-5226-a7a8-2c6bbb6df999, skipping ID generation
2026-03-29 20:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96553639-abb3-5226-a7a8-2c6bbb6df999 with scrape type 1
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96553639-abb3-5226-a7a8-2c6bbb6df999 sending to next pipeline
2026-03-29 20:19:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 96553639-abb3-5226-a7a8-2c6bbb6df999, identifier: 19560308
2026-03-29 20:19:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 96553639-abb3-5226-a7a8-2c6bbb6df999 with identifier: 19560308
2026-03-29 20:19:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 96553639-abb3-5226-a7a8-2c6bbb6df999 with identifier: 19560308
2026-03-29 20:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 96553639-abb3-5226-a7a8-2c6bbb6df999 with identifier: 19560308 to the API
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_rear_driver-1774707093261.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '96553639-abb3-5226-a7a8-2c6bbb6df999',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CU72 VYH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19560308',
'listing': 'auction',
'location': 'West Sussex Horsham',
'make': 'Skoda',
'model': 'Other Skoda',
'odometer': 23360,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989286,
'Height': 2618,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_driver-1774707070461.jpg',
'Width': 3491},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2271373,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_rear_driver-1774707093261.jpg',
'Width': 3750},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173274,
'Height': 2758,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0308/19560308/exterior_front_passenger-1774707136590.jpg',
'Width': 3677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1866177,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0308/19560308/instrument_cluster-1774707724950.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96553639-abb3-5226-a7a8-2c6bbb6df999/96553639-abb3-5226-a7a8-2c6bbb6df999_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5017349,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0308/19560308/interior_boot-1774707549463.jpg',
'Width': 4032}],
'price': 13941,
'price_includes_vat': False,
'registration_date': '2022-12-29',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Enyaq IV 60',
'transmission': 'automatic',
'trim': 'Enyaq IV 60',
'vin': 'TMBKB7NY4PF012508',
'year': 2022}
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719560308%27 HTTP/1.1" 200 None
2026-03-29 20:19:19 [motorway.uk] INFO: Saving data for 19560308: {'created_time': 1774815559.627605, 'last_price_update_time': 1774815559.62762, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19560308') HTTP/1.1" 204 0
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e940d10>
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7201%252F20387201%252Fdocs_service_history-1774372068033.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d8e61b8f5560ec452b5fd8ec7905242') HTTP/1.1" 204 0
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7201/20387201/docs_service_history-1774372068033.jpg?ixlib=js-3.8.0&auto=format&s=0d8e61b8f5560ec452b5fd8ec7905242 saved to cache
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7201/20387201/interior_boot-1774547555845.jpg> (referer: None)
2026-03-29 20:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483899.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9ed90>
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7201%252F20387201%252Finterior_boot-1774547555845.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7201/20387201/interior_boot-1774547555845.jpg saved to cache
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd507959-0c22-529b-a7b9-0d2374f5d5d4 with identifier: 20483899
2026-03-29 20:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd507959-0c22-529b-a7b9-0d2374f5d5d4 with scrape type 1
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_front_driver-1774694244316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_driver-1774694244316.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_rear_driver-1774694263201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_driver-1774694263201.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_front_passenger-1774694350156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_passenger-1774694350156.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_rear_passenger-1774694417116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_passenger-1774694417116.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3899%252F20483899%252Finterior_front_seats-1774713708905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3899/20483899/interior_front_seats-1774713708905.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3899%252F20483899%252Finterior_rear_seats-1774699730775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3899/20483899/interior_rear_seats-1774699730775.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Finterior_dashboard-1774699749614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/interior_dashboard-1774699749614.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Finstrument_cluster-1774699844387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/instrument_cluster-1774699844387.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3899%252F20483899%252Finterior_boot-1774699748677.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3899/20483899/interior_boot-1774699748677.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3899%252F20483899%252Fdocs_service_history-1774702057904.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D558a25f7ebbf00e4ef399de5180c879a%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3899/20483899/docs_service_history-1774702057904.jpg?ixlib=js-3.8.0&auto=format&s=558a25f7ebbf00e4ef399de5180c879a not downloaded yet
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7201/20387201/instrument_cluster-1774372234525.jpg> (referer: None)
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7201/20387201/interior_dashboard-1774528412794.jpg> (referer: None)
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed6e050>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Finstrument_cluster-1774372234525.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/instrument_cluster-1774372234525.jpg saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0103d0>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7201%252F20387201%252Finterior_dashboard-1774528412794.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7201/20387201/interior_dashboard-1774528412794.jpg saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3899/20483899/docs_service_history-1774702057904.jpg?ixlib=js-3.8.0&auto=format&s=558a25f7ebbf00e4ef399de5180c879a> (referer: None)
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed6ef50>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3899%252F20483899%252Fdocs_service_history-1774702057904.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D558a25f7ebbf00e4ef399de5180c879a') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3899/20483899/docs_service_history-1774702057904.jpg?ixlib=js-3.8.0&auto=format&s=558a25f7ebbf00e4ef399de5180c879a saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3899/20483899/instrument_cluster-1774699844387.jpg> (referer: None)
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3899/20483899/interior_boot-1774699748677.jpg> (referer: None)
2026-03-29 20:19:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdbd50>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Finstrument_cluster-1774699844387.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/instrument_cluster-1774699844387.jpg saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed6c250>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3899%252F20483899%252Finterior_boot-1774699748677.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3899/20483899/interior_boot-1774699748677.jpg saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3899/20483899/interior_dashboard-1774699749614.jpg> (referer: None)
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f02a50>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Finterior_dashboard-1774699749614.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/interior_dashboard-1774699749614.jpg saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3899/20483899/interior_front_seats-1774713708905.jpg> (referer: None)
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119990>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3899%252F20483899%252Finterior_front_seats-1774713708905.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3899/20483899/interior_front_seats-1774713708905.jpg saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_passenger-1774694417116.jpg> (referer: None)
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3899/20483899/interior_rear_seats-1774699730775.jpg> (referer: None)
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11af90>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_rear_passenger-1774694417116.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_passenger-1774694417116.jpg saved to cache
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20499683.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c692d90>
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3899%252F20483899%252Finterior_rear_seats-1774699730775.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3899/20483899/interior_rear_seats-1774699730775.jpg saved to cache
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc386bd-0041-57a8-9c4e-03687d293bde with identifier: 20499683
2026-03-29 20:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc386bd-0041-57a8-9c4e-03687d293bde with scrape type 1
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_front_driver-1774782605690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_driver-1774782605690.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_rear_driver-1774782626145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_driver-1774782626145.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_front_passenger-1774782652607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_passenger-1774782652607.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_rear_passenger-1774782632801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_passenger-1774782632801.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9683%252F20499683%252Finterior_front_seats-1774783205544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9683/20499683/interior_front_seats-1774783205544.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9683%252F20499683%252Finterior_rear_seats-1774783231942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9683/20499683/interior_rear_seats-1774783231942.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Finterior_dashboard-1774783264269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/interior_dashboard-1774783264269.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Finstrument_cluster-1774783297351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/instrument_cluster-1774783297351.jpg not downloaded yet
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9683%252F20499683%252Finterior_boot-1774783321960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9683/20499683/interior_boot-1774783321960.jpg not downloaded yet
2026-03-29 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_passenger-1774694350156.jpg> (referer: None)
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9683%252F20499683%252Fdocs_service_history-1774783787980.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da0efd5a7a7a73ecf1706acbdeec94e7e%27 HTTP/1.1" 200 None
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9683/20499683/docs_service_history-1774783787980.jpg?ixlib=js-3.8.0&auto=format&s=a0efd5a7a7a73ecf1706acbdeec94e7e not downloaded yet
2026-03-29 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_driver-1774694244316.jpg> (referer: None)
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf05f90>
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_front_passenger-1774694350156.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_passenger-1774694350156.jpg saved to cache
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2add50>
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_front_driver-1774694244316.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_driver-1774694244316.jpg saved to cache
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9683/20499683/docs_service_history-1774783787980.jpg?ixlib=js-3.8.0&auto=format&s=a0efd5a7a7a73ecf1706acbdeec94e7e> (referer: None)
2026-03-29 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_driver-1774694263201.jpg> (referer: None)
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edba010>
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9683%252F20499683%252Fdocs_service_history-1774783787980.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da0efd5a7a7a73ecf1706acbdeec94e7e') HTTP/1.1" 204 0
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9683/20499683/docs_service_history-1774783787980.jpg?ixlib=js-3.8.0&auto=format&s=a0efd5a7a7a73ecf1706acbdeec94e7e saved to cache
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07090>
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3899%252F20483899%252Fexterior_rear_driver-1774694263201.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_driver-1774694263201.jpg saved to cache
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd507959-0c22-529b-a7b9-0d2374f5d5d4
2026-03-29 20:19:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd507959-0c22-529b-a7b9-0d2374f5d5d4, skipping ID generation
2026-03-29 20:19:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd507959-0c22-529b-a7b9-0d2374f5d5d4 with scrape type 1
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd507959-0c22-529b-a7b9-0d2374f5d5d4 sending to next pipeline
2026-03-29 20:19:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dd507959-0c22-529b-a7b9-0d2374f5d5d4, identifier: 20483899
2026-03-29 20:19:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dd507959-0c22-529b-a7b9-0d2374f5d5d4 with identifier: 20483899
2026-03-29 20:19:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dd507959-0c22-529b-a7b9-0d2374f5d5d4 with identifier: 20483899
2026-03-29 20:19:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dd507959-0c22-529b-a7b9-0d2374f5d5d4 with identifier: 20483899 to the API
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_driver-1774694263201.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dd507959-0c22-529b-a7b9-0d2374f5d5d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AK19 ZVP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20483899',
'listing': 'auction',
'location': 'Northamptonshire Corby',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 13323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1572915,
'Height': 2407,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_driver-1774694244316.jpg',
'Width': 3209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2198736,
'Height': 2879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_driver-1774694263201.jpg',
'Width': 3839},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203063,
'Height': 2802,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_front_passenger-1774694350156.jpg',
'Width': 3736},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1879802,
'Height': 2711,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3899/20483899/exterior_rear_passenger-1774694417116.jpg',
'Width': 3614},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3117124,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3899/20483899/interior_front_seats-1774713708905.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4622385,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3899/20483899/interior_rear_seats-1774699730775.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3213380,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3899/20483899/interior_dashboard-1774699749614.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742547,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3899/20483899/instrument_cluster-1774699844387.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4403932,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3899/20483899/interior_boot-1774699748677.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd507959-0c22-529b-a7b9-0d2374f5d5d4/dd507959-0c22-529b-a7b9-0d2374f5d5d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2274868,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3899/20483899/docs_service_history-1774702057904.jpg?ixlib=js-3.8.0&auto=format&s=558a25f7ebbf00e4ef399de5180c879a',
'Width': 4284}],
'price': 10361,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE EVO',
'transmission': 'manual',
'trim': 'SE EVO',
'vin': 'WVWZZZAWZKU006197',
'year': 2019}
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483899%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [motorway.uk] INFO: Saving data for 20483899: {'created_time': 1774815563.695982, 'last_price_update_time': 1774815563.695992, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20483899') HTTP/1.1" 204 0
2026-03-29 20:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9683/20499683/interior_dashboard-1774783264269.jpg> (referer: None)
2026-03-29 20:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9683/20499683/instrument_cluster-1774783297351.jpg> (referer: None)
2026-03-29 20:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9683/20499683/interior_boot-1774783321960.jpg> (referer: None)
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d770a90>
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Finterior_dashboard-1774783264269.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/interior_dashboard-1774783264269.jpg saved to cache
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07c990>
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Finstrument_cluster-1774783297351.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/instrument_cluster-1774783297351.jpg saved to cache
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea57f50>
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9683%252F20499683%252Finterior_boot-1774783321960.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9683/20499683/interior_boot-1774783321960.jpg saved to cache
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9683/20499683/interior_rear_seats-1774783231942.jpg> (referer: None)
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb94650>
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9683%252F20499683%252Finterior_rear_seats-1774783231942.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9683/20499683/interior_rear_seats-1774783231942.jpg saved to cache
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9683/20499683/interior_front_seats-1774783205544.jpg> (referer: None)
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_passenger-1774782632801.jpg> (referer: None)
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_passenger-1774782652607.jpg> (referer: None)
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f038d0>
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9683%252F20499683%252Finterior_front_seats-1774783205544.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9683/20499683/interior_front_seats-1774783205544.jpg saved to cache
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20386031.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3fa310>
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_rear_passenger-1774782632801.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_passenger-1774782632801.jpg saved to cache
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae6010>
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_front_passenger-1774782652607.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_passenger-1774782652607.jpg saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580bc05b-a55a-581b-9a8e-26f9a1243e0f with identifier: 20386031
2026-03-29 20:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f with scrape type 1
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_front_driver-1774699512869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_driver-1774699512869.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_rear_driver-1774699530057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_driver-1774699530057.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_front_passenger-1774699574696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_passenger-1774699574696.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_rear_passenger-1774699549013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_passenger-1774699549013.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6031%252F20386031%252Finterior_front_seats-1774699876507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6031/20386031/interior_front_seats-1774699876507.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6031%252F20386031%252Finterior_rear_seats-1774699888490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6031/20386031/interior_rear_seats-1774699888490.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6031%252F20386031%252Finterior_dashboard-1774702120663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6031/20386031/interior_dashboard-1774702120663.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Finstrument_cluster-1774699985104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/instrument_cluster-1774699985104.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6031%252F20386031%252Finterior_boot-1774702139412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6031/20386031/interior_boot-1774702139412.jpg not downloaded yet
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6031%252F20386031%252Fdocs_service_history-1774701779193.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3d62e98965c09ae54c739176c357ed3%27 HTTP/1.1" 200 None
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6031/20386031/docs_service_history-1774701779193.jpg?ixlib=js-3.8.0&auto=format&s=a3d62e98965c09ae54c739176c357ed3 not downloaded yet
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_driver-1774782626145.jpg> (referer: None)
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7201/20387201/interior_front_seats-1774547468690.jpg> (referer: None)
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_driver-1774782605690.jpg> (referer: None)
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7201/20387201/interior_rear_seats-1774372663610.jpg> (referer: None)
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea65f50>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_rear_driver-1774782626145.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_driver-1774782626145.jpg saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d545b50>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7201%252F20387201%252Finterior_front_seats-1774547468690.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7201/20387201/interior_front_seats-1774547468690.jpg saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c632510>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9683%252F20499683%252Fexterior_front_driver-1774782605690.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_driver-1774782605690.jpg saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bc386bd-0041-57a8-9c4e-03687d293bde
2026-03-29 20:19:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bc386bd-0041-57a8-9c4e-03687d293bde, skipping ID generation
2026-03-29 20:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc386bd-0041-57a8-9c4e-03687d293bde with scrape type 1
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bc386bd-0041-57a8-9c4e-03687d293bde sending to next pipeline
2026-03-29 20:19:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7bc386bd-0041-57a8-9c4e-03687d293bde, identifier: 20499683
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2edf10>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7201%252F20387201%252Finterior_rear_seats-1774372663610.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7201/20387201/interior_rear_seats-1774372663610.jpg saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7bc386bd-0041-57a8-9c4e-03687d293bde with identifier: 20499683
2026-03-29 20:19:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7bc386bd-0041-57a8-9c4e-03687d293bde with identifier: 20499683
2026-03-29 20:19:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7bc386bd-0041-57a8-9c4e-03687d293bde with identifier: 20499683 to the API
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_driver-1774782605690.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7bc386bd-0041-57a8-9c4e-03687d293bde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD69 TZE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20499683',
'listing': 'auction',
'location': 'Kent Aylesford',
'make': 'Hyundai',
'model': 'I20',
'odometer': 37374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1658283,
'Height': 2493,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_driver-1774782605690.jpg',
'Width': 3324},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593605,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_driver-1774782626145.jpg',
'Width': 3190},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1530376,
'Height': 2282,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_front_passenger-1774782652607.jpg',
'Width': 3042},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1690433,
'Height': 2425,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9683/20499683/exterior_rear_passenger-1774782632801.jpg',
'Width': 3233},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3899452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9683/20499683/interior_front_seats-1774783205544.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4131475,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9683/20499683/interior_rear_seats-1774783231942.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2020129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9683/20499683/interior_dashboard-1774783264269.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467632,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9683/20499683/instrument_cluster-1774783297351.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5316930,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9683/20499683/interior_boot-1774783321960.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bc386bd-0041-57a8-9c4e-03687d293bde/7bc386bd-0041-57a8-9c4e-03687d293bde_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636811,
'Height': 1972,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9683/20499683/docs_service_history-1774783787980.jpg?ixlib=js-3.8.0&auto=format&s=a0efd5a7a7a73ecf1706acbdeec94e7e',
'Width': 2810}],
'price': 9581,
'price_includes_vat': False,
'registration_date': '2019-12-31',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I20 SE T-GDi S-A',
'transmission': 'automatic',
'trim': 'SE T-GDi S-A',
'vin': 'NLHB351AVLZ590784',
'year': 2019}
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499683%27 HTTP/1.1" 200 None
2026-03-29 20:19:26 [motorway.uk] INFO: Saving data for 20499683: {'created_time': 1774815566.338527, 'last_price_update_time': 1774815566.338538, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20499683') HTTP/1.1" 204 0
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6031/20386031/docs_service_history-1774701779193.jpg?ixlib=js-3.8.0&auto=format&s=a3d62e98965c09ae54c739176c357ed3> (referer: None)
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6031/20386031/interior_boot-1774702139412.jpg> (referer: None)
2026-03-29 20:19:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7ba9d0>
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6031%252F20386031%252Fdocs_service_history-1774701779193.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3d62e98965c09ae54c739176c357ed3') HTTP/1.1" 204 0
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6031/20386031/docs_service_history-1774701779193.jpg?ixlib=js-3.8.0&auto=format&s=a3d62e98965c09ae54c739176c357ed3 saved to cache
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec17590>
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6031%252F20386031%252Finterior_boot-1774702139412.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6031/20386031/interior_boot-1774702139412.jpg saved to cache
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20417323.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6031/20386031/instrument_cluster-1774699985104.jpg> (referer: None)
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6031/20386031/interior_rear_seats-1774699888490.jpg> (referer: None)
2026-03-29 20:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac069af-1bd7-5cef-9c55-03fc2cea94d3 with identifier: 20417323
2026-03-29 20:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac069af-1bd7-5cef-9c55-03fc2cea94d3 with scrape type 1
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_front_driver-1774705020624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_driver-1774705020624.jpg not downloaded yet
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_rear_driver-1774705145583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_driver-1774705145583.jpg not downloaded yet
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_front_passenger-1774705061121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_passenger-1774705061121.jpg not downloaded yet
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca375d0>
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Finstrument_cluster-1774699985104.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/instrument_cluster-1774699985104.jpg saved to cache
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_rear_passenger-1774705079393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_passenger-1774705079393.jpg not downloaded yet
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca98450>
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6031%252F20386031%252Finterior_rear_seats-1774699888490.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6031/20386031/interior_rear_seats-1774699888490.jpg saved to cache
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7323%252F20417323%252Finterior_front_seats-1774705607195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7323/20417323/interior_front_seats-1774705607195.jpg not downloaded yet
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7323%252F20417323%252Finterior_rear_seats-1774705619042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7323/20417323/interior_rear_seats-1774705619042.jpg not downloaded yet
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Finterior_dashboard-1774705659223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/interior_dashboard-1774705659223.jpg not downloaded yet
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Finstrument_cluster-1774705709467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/instrument_cluster-1774705709467.jpg not downloaded yet
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7323%252F20417323%252Finterior_boot-1774705691490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7323/20417323/interior_boot-1774705691490.jpg not downloaded yet
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7323%252F20417323%252Fdocs_service_history-1774705811045.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58bff8ef171dd04202222ab66424ccf9%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7323/20417323/docs_service_history-1774705811045.jpg?ixlib=js-3.8.0&auto=format&s=58bff8ef171dd04202222ab66424ccf9 not downloaded yet
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_passenger-1774699549013.jpg> (referer: None)
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_passenger-1774699574696.jpg> (referer: None)
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6031/20386031/interior_front_seats-1774699876507.jpg> (referer: None)
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23c890>
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_rear_passenger-1774699549013.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_passenger-1774699549013.jpg saved to cache
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021d90>
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_front_passenger-1774699574696.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_passenger-1774699574696.jpg saved to cache
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2fdf90>
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6031%252F20386031%252Finterior_front_seats-1774699876507.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6031/20386031/interior_front_seats-1774699876507.jpg saved to cache
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7323/20417323/docs_service_history-1774705811045.jpg?ixlib=js-3.8.0&auto=format&s=58bff8ef171dd04202222ab66424ccf9> (referer: None)
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_passenger-1774705079393.jpg> (referer: None)
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7323/20417323/interior_boot-1774705691490.jpg> (referer: None)
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea47910>
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7323%252F20417323%252Fdocs_service_history-1774705811045.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58bff8ef171dd04202222ab66424ccf9') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7323/20417323/docs_service_history-1774705811045.jpg?ixlib=js-3.8.0&auto=format&s=58bff8ef171dd04202222ab66424ccf9 saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d020210>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_rear_passenger-1774705079393.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_passenger-1774705079393.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093e50>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7323%252F20417323%252Finterior_boot-1774705691490.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7323/20417323/interior_boot-1774705691490.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7323/20417323/interior_rear_seats-1774705619042.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7323/20417323/interior_dashboard-1774705659223.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7323/20417323/instrument_cluster-1774705709467.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7323/20417323/interior_front_seats-1774705607195.jpg> (referer: None)
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093890>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7323%252F20417323%252Finterior_rear_seats-1774705619042.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7323/20417323/interior_rear_seats-1774705619042.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d243090>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Finterior_dashboard-1774705659223.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/interior_dashboard-1774705659223.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23e910>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Finstrument_cluster-1774705709467.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/instrument_cluster-1774705709467.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d241f50>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7323%252F20417323%252Finterior_front_seats-1774705607195.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7323/20417323/interior_front_seats-1774705607195.jpg saved to cache
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_driver-1774705145583.jpg> (referer: None)
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_passenger-1774705061121.jpg> (referer: None)
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdf290>
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_rear_driver-1774705145583.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_driver-1774705145583.jpg saved to cache
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea56550>
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_front_passenger-1774705061121.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_passenger-1774705061121.jpg saved to cache
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_driver-1774705020624.jpg> (referer: None)
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_passenger-1774371593596.jpg> (referer: None)
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_driver-1774699530057.jpg> (referer: None)
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14223294.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2ae890>
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7323%252F20417323%252Fexterior_front_driver-1774705020624.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_driver-1774705020624.jpg saved to cache
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fac069af-1bd7-5cef-9c55-03fc2cea94d3
2026-03-29 20:19:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac069af-1bd7-5cef-9c55-03fc2cea94d3, skipping ID generation
2026-03-29 20:19:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac069af-1bd7-5cef-9c55-03fc2cea94d3 with scrape type 1
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fac069af-1bd7-5cef-9c55-03fc2cea94d3 sending to next pipeline
2026-03-29 20:19:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fac069af-1bd7-5cef-9c55-03fc2cea94d3, identifier: 20417323
2026-03-29 20:19:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fac069af-1bd7-5cef-9c55-03fc2cea94d3 with identifier: 20417323
2026-03-29 20:19:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fac069af-1bd7-5cef-9c55-03fc2cea94d3 with identifier: 20417323
2026-03-29 20:19:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fac069af-1bd7-5cef-9c55-03fc2cea94d3 with identifier: 20417323 to the API
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_driver-1774705020624.jpg>
{'auction_title': '',
'category': None,
'color': 'Brown',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'fac069af-1bd7-5cef-9c55-03fc2cea94d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC19 ZZA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20417323',
'listing': 'auction',
'location': 'Surrey Caterham',
'make': 'Ford',
'model': 'Kuga',
'odometer': 73100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977924,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_driver-1774705020624.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2332486,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_driver-1774705145583.jpg',
'Width': 3642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730306,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_front_passenger-1774705061121.jpg',
'Width': 4015},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2695146,
'Height': 2978,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7323/20417323/exterior_rear_passenger-1774705079393.jpg',
'Width': 3970},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3753357,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7323/20417323/interior_front_seats-1774705607195.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3242064,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7323/20417323/interior_rear_seats-1774705619042.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4000893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7323/20417323/interior_dashboard-1774705659223.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2711122,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7323/20417323/instrument_cluster-1774705709467.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4050048,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7323/20417323/interior_boot-1774705691490.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac069af-1bd7-5cef-9c55-03fc2cea94d3/fac069af-1bd7-5cef-9c55-03fc2cea94d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 989357,
'Height': 3665,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7323/20417323/docs_service_history-1774705811045.jpg?ixlib=js-3.8.0&auto=format&s=58bff8ef171dd04202222ab66424ccf9',
'Width': 2628}],
'price': 9381,
'price_includes_vat': False,
'registration_date': '2019-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga ST-LINE Edition TDCI',
'transmission': 'manual',
'trim': 'ST-LINE Edition TDCI',
'vin': 'WF0AXXWPMAKC05525',
'year': 2019}
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417323%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [motorway.uk] INFO: Saving data for 20417323: {'created_time': 1774815570.226001, 'last_price_update_time': 1774815570.226011, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20417323') HTTP/1.1" 204 0
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c691650>
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_rear_passenger-1774371593596.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_passenger-1774371593596.jpg saved to cache
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ff5d0>
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6031%252F20386031%252Fexterior_rear_driver-1774699530057.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_driver-1774699530057.jpg saved to cache
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f
2026-03-29 20:19:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54991e5a-4e81-581e-a840-9e331246a5ad with identifier: 14223294
2026-03-29 20:19:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54991e5a-4e81-581e-a840-9e331246a5ad with scrape type 1
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_front_driver-default-1774705370322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_driver-default-1774705370322.jpg not downloaded yet
2026-03-29 20:19:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 580bc05b-a55a-581b-9a8e-26f9a1243e0f with identifier: 20386031
2026-03-29 20:19:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 580bc05b-a55a-581b-9a8e-26f9a1243e0f with identifier: 20386031
2026-03-29 20:19:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 580bc05b-a55a-581b-9a8e-26f9a1243e0f with identifier: 20386031 to the API
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '580bc05b-a55a-581b-9a8e-26f9a1243e0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AV69 DAU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20386031',
'listing': 'auction',
'location': 'Greater London Beckenham',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 29176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_driver-1774699512869.jpg',
'https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_driver-1774699530057.jpg',
'https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_passenger-1774699574696.jpg',
'https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_passenger-1774699549013.jpg',
'https://motorway-photos.imgix.net/6031/20386031/interior_front_seats-1774699876507.jpg',
'https://motorway-photos.imgix.net/6031/20386031/interior_rear_seats-1774699888490.jpg',
'https://motorway-photos-modified.imgix.net/6031/20386031/interior_dashboard-1774702120663.jpg',
'https://motorway-photos-redacted.imgix.net/6031/20386031/instrument_cluster-1774699985104.jpg',
'https://motorway-photos-modified.imgix.net/6031/20386031/interior_boot-1774702139412.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/6031/20386031/docs_service_history-1774701779193.jpg?ixlib=js-3.8.0&auto=format&s=a3d62e98965c09ae54c739176c357ed3'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1785628,
'Height': 2731,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_driver-1774699530057.jpg',
'Width': 3641},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2149390,
'Height': 2924,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_front_passenger-1774699574696.jpg',
'Width': 3899},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238854,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6031/20386031/exterior_rear_passenger-1774699549013.jpg',
'Width': 3091},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3717196,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6031/20386031/interior_front_seats-1774699876507.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3369869,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6031/20386031/interior_rear_seats-1774699888490.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1793879,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6031/20386031/instrument_cluster-1774699985104.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3654009,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6031/20386031/interior_boot-1774702139412.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580bc05b-a55a-581b-9a8e-26f9a1243e0f/580bc05b-a55a-581b-9a8e-26f9a1243e0f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2184624,
'Height': 2827,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6031/20386031/docs_service_history-1774701779193.jpg?ixlib=js-3.8.0&auto=format&s=a3d62e98965c09ae54c739176c357ed3',
'Width': 2016}],
'price': 15015,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Karoq SE L TSI S-A',
'transmission': 'automatic',
'trim': 'SE L TSI S-A',
'vin': 'TMBKR7NU2LJ007520',
'year': 2019}
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386031%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [motorway.uk] INFO: Saving data for 20386031: {'created_time': 1774815570.988693, 'last_price_update_time': 1774815570.988704, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20386031') HTTP/1.1" 204 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_rear_driver-default-1774705375056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_driver-default-1774705375056.jpg not downloaded yet
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 580bc05b-a55a-581b-9a8e-26f9a1243e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_front_passenger-default-1774705369803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_passenger-default-1774705369803.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_rear_passenger-default-1774705379101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_passenger-default-1774705379101.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3294%252F14223294%252F14223294-interior_front_seats-default-1774705417055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3294/14223294/14223294-interior_front_seats-default-1774705417055.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3294%252F14223294%252F14223294-interior_rear_seats-default-1774705418868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3294/14223294/14223294-interior_rear_seats-default-1774705418868.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-interior_dashboard-default-1774705438583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-interior_dashboard-default-1774705438583.jpg not downloaded yet
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_driver-1774371577528.jpg> (referer: None)
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3294%252F14223294%252F14223294-interior_boot-default-1774705372329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3294/14223294/14223294-interior_boot-default-1774705372329.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3294%252F14223294%252F14223294-docs_service_history-modified-1753622290338.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2505c82c60bc64ea3f21135939ff9392%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622290338.jpeg?ixlib=js-3.8.0&auto=format&s=2505c82c60bc64ea3f21135939ff9392 not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3294%252F14223294%252F14223294-docs_service_history-modified-1753622259334.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0dfde7bd6df6c131cbe4e5a6b7cf7f21%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622259334.jpeg?ixlib=js-3.8.0&auto=format&s=0dfde7bd6df6c131cbe4e5a6b7cf7f21 not downloaded yet
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_driver-1774371585684.jpg> (referer: None)
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_passenger-1774371590700.jpg> (referer: None)
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119450>
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_front_driver-1774371577528.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_driver-1774371577528.jpg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce70e90>
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_rear_driver-1774371585684.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_driver-1774371585684.jpg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae7110>
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7201%252F20387201%252Fexterior_front_passenger-1774371590700.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_passenger-1774371590700.jpg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53
2026-03-29 20:19:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53, skipping ID generation
2026-03-29 20:19:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 with scrape type 1
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 sending to next pipeline
2026-03-29 20:19:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53, identifier: 20387201
2026-03-29 20:19:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 with identifier: 20387201
2026-03-29 20:19:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 with identifier: 20387201
2026-03-29 20:19:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53 with identifier: 20387201 to the API
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_passenger-1774371590700.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR18 WRX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20387201',
'listing': 'auction',
'location': 'Greater London Bexleyheath',
'make': 'Audi',
'model': 'S5',
'odometer': 60000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1066909,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_driver-1774371577528.jpg',
'Width': 3307},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1513517,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_driver-1774371585684.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1705518,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_front_passenger-1774371590700.jpg',
'Width': 3202},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1274690,
'Height': 2627,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7201/20387201/exterior_rear_passenger-1774371593596.jpg',
'Width': 3503},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2228300,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7201/20387201/interior_front_seats-1774547468690.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1326482,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7201/20387201/interior_rear_seats-1774372663610.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1669187,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7201/20387201/interior_dashboard-1774528412794.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1164809,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7201/20387201/instrument_cluster-1774372234525.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2361786,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7201/20387201/interior_boot-1774547555845.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53/c0bf4c67-fc0c-59cb-a8e8-9d83e4795b53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453848,
'Height': 2320,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7201/20387201/docs_service_history-1774372068033.jpg?ixlib=js-3.8.0&auto=format&s=0d8e61b8f5560ec452b5fd8ec7905242',
'Width': 1648}],
'price': 18857,
'price_includes_vat': False,
'registration_date': '2018-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi S5 TFSI Quattro Auto',
'transmission': 'automatic',
'trim': 'TFSI Quattro Auto',
'vin': 'WAUZZZF51JA093897',
'year': 2018}
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387201%27 HTTP/1.1" 200 None
2026-03-29 20:19:32 [motorway.uk] INFO: Saving data for 20387201: {'created_time': 1774815572.08582, 'last_price_update_time': 1774815572.085833, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20387201') HTTP/1.1" 204 0
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622259334.jpeg?ixlib=js-3.8.0&auto=format&s=0dfde7bd6df6c131cbe4e5a6b7cf7f21> (referer: None)
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622290338.jpeg?ixlib=js-3.8.0&auto=format&s=2505c82c60bc64ea3f21135939ff9392> (referer: None)
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_passenger-1774784756882.jpg> (referer: None)
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-interior_dashboard-default-1774705438583.jpg> (referer: None)
2026-03-29 20:19:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1d9b8a8d-a478-541b-b983-06c5cbd50afe with identifier: 20481812
2026-03-29 20:19:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1d9b8a8d-a478-541b-b983-06c5cbd50afe with identifier: 20481812
2026-03-29 20:19:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1d9b8a8d-a478-541b-b983-06c5cbd50afe with identifier: 20481812 to the API
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:33 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '1d9b8a8d-a478-541b-b983-06c5cbd50afe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG23 WKL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20481812',
'listing': 'auction',
'location': 'Buckinghamshire Marlow',
'make': 'Tesla',
'model': 'Model Y',
'odometer': 49889,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_driver-1774693138420.jpg',
'https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_rear_driver-1774693167137.jpg',
'https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_passenger-1774693291748.jpg',
'https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_rear_passenger-1774693226165.jpg',
'https://motorway-photos.imgix.net/1812/20481812/interior_front_seats-1774694216788.jpg',
'https://motorway-photos.imgix.net/1812/20481812/interior_rear_seats-1774694106551.jpg',
'https://motorway-photos-modified.imgix.net/1812/20481812/20481812-interior_dashboard-modified-1774694871347.jpeg',
'https://motorway-photos.imgix.net/1812/20481812/interior_boot-1774694179060.jpg',
'https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693344132.jpg',
'https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693381779.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1907230,
'Height': 2683,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1812/20481812/exterior_front_driver-1774693138420.jpg',
'Width': 3577},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3016109,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1812/20481812/interior_front_seats-1774694216788.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3113712,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693344132.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9b8a8d-a478-541b-b983-06c5cbd50afe/1d9b8a8d-a478-541b-b983-06c5cbd50afe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4155192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1812/20481812/damage_scratches-1774693381779.jpg',
'Width': 4032}],
'price': 21204,
'price_includes_vat': False,
'registration_date': '2023-03-07',
'seats_number': None,
'seller_name': None,
'title': 'Tesla Model Y Long Range AWD',
'transmission': 'automatic',
'trim': 'Long Range AWD',
'vin': 'LRWYHCEK6PC727804',
'year': 2023}
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481812%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [motorway.uk] INFO: Saving data for 20481812: {'created_time': 1774815573.245875, 'last_price_update_time': 1774815573.245885, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20481812') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1d9b8a8d-a478-541b-b983-06c5cbd50afe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 with identifier: 20485589
2026-03-29 20:19:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 with identifier: 20485589
2026-03-29 20:19:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 with identifier: 20485589 to the API
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:33 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e17ad40d-8a52-5b1f-b8ef-1e59f77bff32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF66 CZX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485589',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Bentley',
'model': 'Continental',
'odometer': 21117,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_driver-1774700332686.jpg',
'https://motorway-photos-modified.imgix.net/5589/20485589/exterior_rear_driver-1774701867794.jpg',
'https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_passenger-1774700341926.jpg',
'https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_rear_passenger-1774700336639.jpg',
'https://motorway-photos.imgix.net/5589/20485589/interior_front_seats-1774700701236.jpg',
'https://motorway-photos.imgix.net/5589/20485589/interior_rear_seats-1774700703932.jpg',
'https://motorway-photos-modified.imgix.net/5589/20485589/interior_dashboard-1774701886550.jpg',
'https://motorway-photos-redacted.imgix.net/5589/20485589/instrument_cluster-1774700739955.jpg',
'https://motorway-photos.imgix.net/5589/20485589/interior_boot-1774700708718.jpg',
'https://motorway-service-history-photos.imgix.net/modified/5589/20485589/docs_service_history-1774701849331.jpg?ixlib=js-3.8.0&auto=format&s=059c0472aeedd9aed966e1db51a5fe66'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17ad40d-8a52-5b1f-b8ef-1e59f77bff32/e17ad40d-8a52-5b1f-b8ef-1e59f77bff32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625126,
'Height': 2680,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5589/20485589/exterior_front_driver-1774700332686.jpg',
'Width': 3573},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17ad40d-8a52-5b1f-b8ef-1e59f77bff32/e17ad40d-8a52-5b1f-b8ef-1e59f77bff32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2372118,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5589/20485589/interior_front_seats-1774700701236.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17ad40d-8a52-5b1f-b8ef-1e59f77bff32/e17ad40d-8a52-5b1f-b8ef-1e59f77bff32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1433805,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5589/20485589/instrument_cluster-1774700739955.jpg',
'Width': 3840}],
'price': 48952,
'price_includes_vat': False,
'registration_date': '2016-09-09',
'seats_number': None,
'seller_name': None,
'title': 'Bentley Continental GT S V8 MDS Auto',
'transmission': 'automatic',
'trim': 'GT S V8 MDS Auto',
'vin': 'SCBFE63WXHC060685',
'year': 2016}
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485589%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [motorway.uk] INFO: Saving data for 20485589: {'created_time': 1774815573.666639, 'last_price_update_time': 1774815573.666656, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485589') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item e17ad40d-8a52-5b1f-b8ef-1e59f77bff32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20421091.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22f690>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3294%252F14223294%252F14223294-docs_service_history-modified-1753622259334.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0dfde7bd6df6c131cbe4e5a6b7cf7f21') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622259334.jpeg?ixlib=js-3.8.0&auto=format&s=0dfde7bd6df6c131cbe4e5a6b7cf7f21 saved to cache
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5a390>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3294%252F14223294%252F14223294-docs_service_history-modified-1753622290338.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2505c82c60bc64ea3f21135939ff9392') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622290338.jpeg?ixlib=js-3.8.0&auto=format&s=2505c82c60bc64ea3f21135939ff9392 saved to cache
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edb85d0>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9918%252F9709918%252Fexterior_rear_passenger-1774784756882.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_passenger-1774784756882.jpg saved to cache
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62
2026-03-29 20:19:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dc96ec6-37d0-5aad-91f3-fed5dc539b62, skipping ID generation
2026-03-29 20:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 with scrape type 1
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 sending to next pipeline
2026-03-29 20:19:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5dc96ec6-37d0-5aad-91f3-fed5dc539b62, identifier: 9709918
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05ba50>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-interior_dashboard-default-1774705438583.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-interior_dashboard-default-1774705438583.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 with identifier: 9709918
2026-03-29 20:19:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 with identifier: 9709918
2026-03-29 20:19:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5dc96ec6-37d0-5aad-91f3-fed5dc539b62 with identifier: 9709918 to the API
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_passenger-1774784756882.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '5dc96ec6-37d0-5aad-91f3-fed5dc539b62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HG67 YNZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9709918',
'listing': 'auction',
'location': 'Southampton Southampton',
'make': 'Lexus',
'model': 'RC 300',
'odometer': 38124,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2401742,
'Height': 2641,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_front_driver-1774784737628.jpg',
'Width': 3521},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1530714,
'Height': 2113,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_driver-1774784713557.jpg',
'Width': 2817},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771692,
'Height': 2384,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9918/9709918/exterior_rear_passenger-1774784756882.jpg',
'Width': 3179},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3762533,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9918/9709918/interior_front_seats-1774785293948.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc96ec6-37d0-5aad-91f3-fed5dc539b62/5dc96ec6-37d0-5aad-91f3-fed5dc539b62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3645127,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9918/9709918/interior_boot-1774785397261.jpg',
'Width': 4032}],
'price': 17305,
'price_includes_vat': False,
'registration_date': '2017-09-22',
'seats_number': None,
'seller_name': None,
'title': 'Lexus RC 300H F Sport CVT',
'transmission': 'automatic',
'trim': 'H F Sport CVT',
'vin': 'JTHHH5BC405002920',
'year': 2017}
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279709918%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [motorway.uk] INFO: Saving data for 9709918: {'created_time': 1774815574.508696, 'last_price_update_time': 1774815574.508721, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9709918') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6141031d-03c0-5205-922e-f605d340079a with identifier: 20421091
2026-03-29 20:19:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6141031d-03c0-5205-922e-f605d340079a with scrape type 1
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_front_driver-1774363545708.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_driver-1774363545708.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_rear_driver-1774363556596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_driver-1774363556596.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_front_passenger-1774363624448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_passenger-1774363624448.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_rear_passenger-1774363609785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_passenger-1774363609785.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1091%252F20421091%252Finterior_front_seats-1774363837966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1091/20421091/interior_front_seats-1774363837966.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1091%252F20421091%252Finterior_rear_seats-1774363848889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1091/20421091/interior_rear_seats-1774363848889.jpg not downloaded yet
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_driver-default-1774705375056.jpg> (referer: None)
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1091%252F20421091%252Finterior_dashboard-1774364414613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1091/20421091/interior_dashboard-1774364414613.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1091%252F20421091%252Finstrument_cluster-1774364428758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1091/20421091/instrument_cluster-1774364428758.jpg not downloaded yet
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1091%252F20421091%252Finterior_boot-1774363888899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1091/20421091/interior_boot-1774363888899.jpg not downloaded yet
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3294/14223294/14223294-interior_boot-default-1774705372329.jpg> (referer: None)
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1091%252F20421091%252Fdocs_service_history-1774624638298-3.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc64748c353d4ba2e575a4cec673e1014%27 HTTP/1.1" 200 None
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1091/20421091/docs_service_history-1774624638298-3.jpeg?ixlib=js-3.8.0&auto=format&s=c64748c353d4ba2e575a4cec673e1014 not downloaded yet
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_passenger-default-1774705369803.jpg> (referer: None)
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0227d0>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_rear_driver-default-1774705375056.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_driver-default-1774705375056.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3294/14223294/14223294-interior_rear_seats-default-1774705418868.jpg> (referer: None)
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1091/20421091/docs_service_history-1774624638298-3.jpeg?ixlib=js-3.8.0&auto=format&s=c64748c353d4ba2e575a4cec673e1014> (referer: None)
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3294/14223294/14223294-interior_front_seats-default-1774705417055.jpg> (referer: None)
2026-03-29 20:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_passenger-default-1774705379101.jpg> (referer: None)
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d020190>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3294%252F14223294%252F14223294-interior_boot-default-1774705372329.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3294/14223294/14223294-interior_boot-default-1774705372329.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd4550>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_front_passenger-default-1774705369803.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_passenger-default-1774705369803.jpg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e072d10>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3294%252F14223294%252F14223294-interior_rear_seats-default-1774705418868.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3294/14223294/14223294-interior_rear_seats-default-1774705418868.jpg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d571910>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1091%252F20421091%252Fdocs_service_history-1774624638298-3.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc64748c353d4ba2e575a4cec673e1014') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1091/20421091/docs_service_history-1774624638298-3.jpeg?ixlib=js-3.8.0&auto=format&s=c64748c353d4ba2e575a4cec673e1014 saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2dbfd0>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3294%252F14223294%252F14223294-interior_front_seats-default-1774705417055.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3294/14223294/14223294-interior_front_seats-default-1774705417055.jpg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d078910>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_rear_passenger-default-1774705379101.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_passenger-default-1774705379101.jpg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_driver-default-1774705370322.jpg> (referer: None)
2026-03-29 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1091/20421091/interior_boot-1774363888899.jpg> (referer: None)
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d8950>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3294%252F14223294%252F14223294-exterior_front_driver-default-1774705370322.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_driver-default-1774705370322.jpg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54991e5a-4e81-581e-a840-9e331246a5ad
2026-03-29 20:19:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54991e5a-4e81-581e-a840-9e331246a5ad, skipping ID generation
2026-03-29 20:19:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54991e5a-4e81-581e-a840-9e331246a5ad with scrape type 1
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54991e5a-4e81-581e-a840-9e331246a5ad sending to next pipeline
2026-03-29 20:19:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 54991e5a-4e81-581e-a840-9e331246a5ad, identifier: 14223294
2026-03-29 20:19:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 54991e5a-4e81-581e-a840-9e331246a5ad with identifier: 14223294
2026-03-29 20:19:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 54991e5a-4e81-581e-a840-9e331246a5ad with identifier: 14223294
2026-03-29 20:19:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 54991e5a-4e81-581e-a840-9e331246a5ad with identifier: 14223294 to the API
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_driver-default-1774705370322.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '54991e5a-4e81-581e-a840-9e331246a5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT68 VOC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14223294',
'listing': 'auction',
'location': 'Milton Keynes Milton Keynes',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 41531,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2651004,
'Height': 2940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_driver-default-1774705370322.jpg',
'Width': 3920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1218025,
'Height': 2868,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_driver-default-1774705375056.jpg',
'Width': 3824},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1840885,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_front_passenger-default-1774705369803.jpg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421489,
'Height': 2832,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-exterior_rear_passenger-default-1774705379101.jpg',
'Width': 3776},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2359874,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3294/14223294/14223294-interior_front_seats-default-1774705417055.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2335512,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3294/14223294/14223294-interior_rear_seats-default-1774705418868.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2234421,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3294/14223294/14223294-interior_dashboard-default-1774705438583.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642469,
'Height': 2297,
'OriginUrl': 'https://motorway-photos.imgix.net/3294/14223294/14223294-interior_boot-default-1774705372329.jpg',
'Width': 3063},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107168,
'Height': 1502,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622290338.jpeg?ixlib=js-3.8.0&auto=format&s=2505c82c60bc64ea3f21135939ff9392',
'Width': 1126},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54991e5a-4e81-581e-a840-9e331246a5ad/54991e5a-4e81-581e-a840-9e331246a5ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106535,
'Height': 1432,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3294/14223294/14223294-docs_service_history-modified-1753622259334.jpeg?ixlib=js-3.8.0&auto=format&s=0dfde7bd6df6c131cbe4e5a6b7cf7f21',
'Width': 1074}],
'price': 15084,
'price_includes_vat': False,
'registration_date': '2018-10-12',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 AMG Line Premium + Auto',
'transmission': 'automatic',
'trim': 'A 200 AMG Line Premium + Auto',
'vin': 'WDD1770872N023456',
'year': 2018}
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714223294%27 HTTP/1.1" 200 None
2026-03-29 20:19:36 [motorway.uk] INFO: Saving data for 14223294: {'created_time': 1774815576.129197, 'last_price_update_time': 1774815576.129207, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14223294') HTTP/1.1" 204 0
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2132d0>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1091%252F20421091%252Finterior_boot-1774363888899.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1091/20421091/interior_boot-1774363888899.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 6141031d-03c0-5205-922e-f605d340079a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1091/20421091/instrument_cluster-1774364428758.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_passenger-1774363624448.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_passenger-1774363609785.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1091/20421091/interior_rear_seats-1774363848889.jpg> (referer: None)
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbe8cd0>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1091%252F20421091%252Finstrument_cluster-1774364428758.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1091/20421091/instrument_cluster-1774364428758.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_driver-1774363545708.jpg> (referer: None)
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d078510>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_front_passenger-1774363624448.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_passenger-1774363624448.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1d810>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_rear_passenger-1774363609785.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_passenger-1774363609785.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed61690>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1091%252F20421091%252Finterior_rear_seats-1774363848889.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1091/20421091/interior_rear_seats-1774363848889.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 6141031d-03c0-5205-922e-f605d340079a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1d150>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_front_driver-1774363545708.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_driver-1774363545708.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_driver-1774363556596.jpg> (referer: None)
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd6890>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1091%252F20421091%252Fexterior_rear_driver-1774363556596.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_driver-1774363556596.jpg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6141031d-03c0-5205-922e-f605d340079a
2026-03-29 20:19:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6141031d-03c0-5205-922e-f605d340079a, skipping ID generation
2026-03-29 20:19:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6141031d-03c0-5205-922e-f605d340079a with scrape type 1
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6141031d-03c0-5205-922e-f605d340079a sending to next pipeline
2026-03-29 20:19:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6141031d-03c0-5205-922e-f605d340079a, identifier: 20421091
2026-03-29 20:19:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6141031d-03c0-5205-922e-f605d340079a with identifier: 20421091
2026-03-29 20:19:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6141031d-03c0-5205-922e-f605d340079a with identifier: 20421091
2026-03-29 20:19:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6141031d-03c0-5205-922e-f605d340079a with identifier: 20421091 to the API
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_driver-1774363556596.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '6141031d-03c0-5205-922e-f605d340079a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RX23 WAU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20421091',
'listing': 'auction',
'location': 'Greater London Feltham',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 31000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1785535,
'Height': 2252,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_driver-1774363545708.jpg',
'Width': 3002},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2049947,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_driver-1774363556596.jpg',
'Width': 3299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771228,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_front_passenger-1774363624448.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1793013,
'Height': 2531,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1091/20421091/exterior_rear_passenger-1774363609785.jpg',
'Width': 3374},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3907315,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1091/20421091/interior_rear_seats-1774363848889.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1563234,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1091/20421091/instrument_cluster-1774364428758.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3755026,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1091/20421091/interior_boot-1774363888899.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6141031d-03c0-5205-922e-f605d340079a/6141031d-03c0-5205-922e-f605d340079a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58461,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1091/20421091/docs_service_history-1774624638298-3.jpeg?ixlib=js-3.8.0&auto=format&s=c64748c353d4ba2e575a4cec673e1014',
'Width': 892}],
'price': 58472,
'price_includes_vat': False,
'registration_date': '2023-03-24',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG GLE 53 PREMIUM+ MHEV 4M+ A',
'transmission': 'automatic',
'trim': 'GLE 53 PREMIUM+ MHEV 4M+ A',
'vin': 'W1NFB6BE3PA911680',
'year': 2023}
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421091%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Saving data for 20421091: {'created_time': 1774815577.641667, 'last_price_update_time': 1774815577.641675, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20421091') HTTP/1.1" 204 0
2026-03-29 20:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19413644.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb101cef-5158-5ddf-ad36-c71865c3ac28 with identifier: 19413644
2026-03-29 20:19:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb101cef-5158-5ddf-ad36-c71865c3ac28 with scrape type 1
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_front_driver-1774712847800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_driver-1774712847800.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_rear_driver-1774712851173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_driver-1774712851173.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_front_passenger-1774712856432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_passenger-1774712856432.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_rear_passenger-1774712843886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_passenger-1774712843886.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3644%252F19413644%252Finterior_front_seats-1774713348524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3644/19413644/interior_front_seats-1774713348524.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3644%252F19413644%252Finterior_rear_seats-1774713263188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3644/19413644/interior_rear_seats-1774713263188.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Finterior_dashboard-1774713280262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/interior_dashboard-1774713280262.jpg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3644%252F19413644%252Finterior_boot-1774713268389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3644/19413644/interior_boot-1774713268389.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3644%252F19413644%252Fdocs_service_history-1774713414318.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dad0688ccdcfdeaa91c9af52a35864c96%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713414318.jpg?ixlib=js-3.8.0&auto=format&s=ad0688ccdcfdeaa91c9af52a35864c96 not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3644%252F19413644%252Fdocs_service_history-1774713457962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac67e2fcff772b238cdae9c562b4cc06%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713457962.jpg?ixlib=js-3.8.0&auto=format&s=ac67e2fcff772b238cdae9c562b4cc06 not downloaded yet
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_driver-1774712847800.jpg> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713457962.jpg?ixlib=js-3.8.0&auto=format&s=ac67e2fcff772b238cdae9c562b4cc06> (referer: None)
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c7e290>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_front_driver-1774712847800.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_driver-1774712847800.jpg saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x03\xc8'
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\tH'
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12ebd0>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3644%252F19413644%252Fdocs_service_history-1774713457962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac67e2fcff772b238cdae9c562b4cc06') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713457962.jpg?ixlib=js-3.8.0&auto=format&s=ac67e2fcff772b238cdae9c562b4cc06 saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713414318.jpg?ixlib=js-3.8.0&auto=format&s=ad0688ccdcfdeaa91c9af52a35864c96> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_driver-1774712851173.jpg> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3644/19413644/interior_rear_seats-1774713263188.jpg> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_passenger-1774712856432.jpg> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3644/19413644/interior_front_seats-1774713348524.jpg> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_passenger-1774712843886.jpg> (referer: None)
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x03\xc8'
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\tH'
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:19:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e091cd0>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3644%252F19413644%252Fdocs_service_history-1774713414318.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dad0688ccdcfdeaa91c9af52a35864c96') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713414318.jpg?ixlib=js-3.8.0&auto=format&s=ad0688ccdcfdeaa91c9af52a35864c96 saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec07ed0>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_rear_driver-1774712851173.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_driver-1774712851173.jpg saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca99450>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3644%252F19413644%252Finterior_rear_seats-1774713263188.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3644/19413644/interior_rear_seats-1774713263188.jpg saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3fa10>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_front_passenger-1774712856432.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_passenger-1774712856432.jpg saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cee0590>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3644%252F19413644%252Finterior_front_seats-1774713348524.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3644/19413644/interior_front_seats-1774713348524.jpg saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec97990>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3644%252F19413644%252Fexterior_rear_passenger-1774712843886.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_passenger-1774712843886.jpg saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3644/19413644/interior_boot-1774713268389.jpg> (referer: None)
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item bb101cef-5158-5ddf-ad36-c71865c3ac28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e11d0>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3644%252F19413644%252Finterior_boot-1774713268389.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3644/19413644/interior_boot-1774713268389.jpg saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb101cef-5158-5ddf-ad36-c71865c3ac28
2026-03-29 20:19:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb101cef-5158-5ddf-ad36-c71865c3ac28, skipping ID generation
2026-03-29 20:19:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb101cef-5158-5ddf-ad36-c71865c3ac28 with scrape type 1
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb101cef-5158-5ddf-ad36-c71865c3ac28 sending to next pipeline
2026-03-29 20:19:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bb101cef-5158-5ddf-ad36-c71865c3ac28, identifier: 19413644
2026-03-29 20:19:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bb101cef-5158-5ddf-ad36-c71865c3ac28 with identifier: 19413644
2026-03-29 20:19:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bb101cef-5158-5ddf-ad36-c71865c3ac28 with identifier: 19413644
2026-03-29 20:19:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bb101cef-5158-5ddf-ad36-c71865c3ac28 with identifier: 19413644 to the API
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3644/19413644/interior_boot-1774713268389.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bb101cef-5158-5ddf-ad36-c71865c3ac28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX72 XBN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19413644',
'listing': 'auction',
'location': 'Buckinghamshire Chalfont Saint Giles',
'make': 'Audi',
'model': 'A5',
'odometer': 30374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1918259,
'Height': 2499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_driver-1774712847800.jpg',
'Width': 3332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1260311,
'Height': 2567,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_driver-1774712851173.jpg',
'Width': 3422},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538570,
'Height': 2830,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_front_passenger-1774712856432.jpg',
'Width': 3773},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2757366,
'Height': 2870,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3644/19413644/exterior_rear_passenger-1774712843886.jpg',
'Width': 3827},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2584802,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3644/19413644/interior_front_seats-1774713348524.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2406933,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3644/19413644/interior_rear_seats-1774713263188.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1908758,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3644/19413644/interior_boot-1774713268389.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328840,
'Height': 2376,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713414318.jpg?ixlib=js-3.8.0&auto=format&s=ad0688ccdcfdeaa91c9af52a35864c96',
'Width': 968},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb101cef-5158-5ddf-ad36-c71865c3ac28/bb101cef-5158-5ddf-ad36-c71865c3ac28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328840,
'Height': 2376,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3644/19413644/docs_service_history-1774713457962.jpg?ixlib=js-3.8.0&auto=format&s=ac67e2fcff772b238cdae9c562b4cc06',
'Width': 968}],
'price': 23551,
'price_includes_vat': False,
'registration_date': '2022-09-09',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S LN BLK ED 40 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S LN BLK ED 40 TFSI MHEV SA',
'vin': 'WAUZZZF56PA002163',
'year': 2022}
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719413644%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [motorway.uk] INFO: Saving data for 19413644: {'created_time': 1774815581.920934, 'last_price_update_time': 1774815581.920945, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19413644') HTTP/1.1" 204 0
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488693.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 884bf42f-d8ed-54a9-83e9-f268f4487e06 with identifier: 20488693
2026-03-29 20:19:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 884bf42f-d8ed-54a9-83e9-f268f4487e06 with scrape type 1
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8693%252F20488693%252Fexterior_front_driver-1774776345612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8693/20488693/exterior_front_driver-1774776345612.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8693%252F20488693%252Fexterior_rear_driver-1774704800275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_driver-1774704800275.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8693%252F20488693%252Fexterior_front_passenger-1774704802357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_front_passenger-1774704802357.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8693%252F20488693%252Fexterior_rear_passenger-1774704834002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_passenger-1774704834002.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8693%252F20488693%252Finterior_front_seats-1774705200839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8693/20488693/interior_front_seats-1774705200839.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8693%252F20488693%252Finterior_rear_seats-1774776731230.png%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8693/20488693/interior_rear_seats-1774776731230.png not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8693%252F20488693%252Finterior_dashboard-1774777573219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8693/20488693/interior_dashboard-1774777573219.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8693%252F20488693%252Finterior_boot-1774777583527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8693/20488693/interior_boot-1774777583527.jpg not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8693%252F20488693%252Fdocs_service_history-1774776301507.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D43f37b5cd2fd7f9f650291c63fd3a981%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8693/20488693/docs_service_history-1774776301507.jpg?ixlib=js-3.8.0&auto=format&s=43f37b5cd2fd7f9f650291c63fd3a981 not downloaded yet
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8693%252F20488693%252Fdocs_service_history-1774705478929.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98448e3f28ef607d76c5f6fb276dd031%27 HTTP/1.1" 200 None
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8693/20488693/docs_service_history-1774705478929.jpg?ixlib=js-3.8.0&auto=format&s=98448e3f28ef607d76c5f6fb276dd031 not downloaded yet
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8693/20488693/exterior_front_driver-1774776345612.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8693/20488693/interior_rear_seats-1774776731230.png> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8693/20488693/interior_front_seats-1774705200839.jpg> (referer: None)
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01d190>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8693%252F20488693%252Fexterior_front_driver-1774776345612.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8693/20488693/exterior_front_driver-1774776345612.jpg saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:45 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:19:45 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 32768
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d038590>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_5.png HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8693%252F20488693%252Finterior_rear_seats-1774776731230.png') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8693/20488693/interior_rear_seats-1774776731230.png saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d038590>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8693%252F20488693%252Finterior_front_seats-1774705200839.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8693/20488693/interior_front_seats-1774705200839.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8693/20488693/docs_service_history-1774776301507.jpg?ixlib=js-3.8.0&auto=format&s=43f37b5cd2fd7f9f650291c63fd3a981> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_front_passenger-1774704802357.jpg> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_passenger-1774704834002.jpg> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_driver-1774704800275.jpg> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8693/20488693/docs_service_history-1774705478929.jpg?ixlib=js-3.8.0&auto=format&s=98448e3f28ef607d76c5f6fb276dd031> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8693/20488693/interior_dashboard-1774777573219.jpg> (referer: None)
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c65a210>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8693%252F20488693%252Fdocs_service_history-1774776301507.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D43f37b5cd2fd7f9f650291c63fd3a981') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8693/20488693/docs_service_history-1774776301507.jpg?ixlib=js-3.8.0&auto=format&s=43f37b5cd2fd7f9f650291c63fd3a981 saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0780d0>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8693%252F20488693%252Fexterior_front_passenger-1774704802357.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_front_passenger-1774704802357.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca53210>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8693%252F20488693%252Fexterior_rear_passenger-1774704834002.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_passenger-1774704834002.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e02c650>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8693%252F20488693%252Fexterior_rear_driver-1774704800275.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_driver-1774704800275.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1783d0>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8693%252F20488693%252Fdocs_service_history-1774705478929.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98448e3f28ef607d76c5f6fb276dd031') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8693/20488693/docs_service_history-1774705478929.jpg?ixlib=js-3.8.0&auto=format&s=98448e3f28ef607d76c5f6fb276dd031 saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadebd0>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8693%252F20488693%252Finterior_dashboard-1774777573219.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8693/20488693/interior_dashboard-1774777573219.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06
2026-03-29 20:19:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 884bf42f-d8ed-54a9-83e9-f268f4487e06 with identifier: 20488693
2026-03-29 20:19:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 884bf42f-d8ed-54a9-83e9-f268f4487e06 with identifier: 20488693
2026-03-29 20:19:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 884bf42f-d8ed-54a9-83e9-f268f4487e06 with identifier: 20488693 to the API
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:47 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '884bf42f-d8ed-54a9-83e9-f268f4487e06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS69 PHN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488693',
'listing': 'auction',
'location': 'Dorset Wimborne',
'make': 'Volvo',
'model': 'XC90',
'odometer': 49500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-modified.imgix.net/8693/20488693/exterior_front_driver-1774776345612.jpg',
'https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_driver-1774704800275.jpg',
'https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_front_passenger-1774704802357.jpg',
'https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_passenger-1774704834002.jpg',
'https://motorway-photos.imgix.net/8693/20488693/interior_front_seats-1774705200839.jpg',
'https://motorway-photos.imgix.net/8693/20488693/interior_rear_seats-1774776731230.png',
'https://motorway-photos-modified.imgix.net/8693/20488693/interior_dashboard-1774777573219.jpg',
'https://motorway-photos-modified.imgix.net/8693/20488693/interior_boot-1774777583527.jpg',
'https://motorway-service-history-photos.imgix.net/modified/8693/20488693/docs_service_history-1774776301507.jpg?ixlib=js-3.8.0&auto=format&s=43f37b5cd2fd7f9f650291c63fd3a981',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8693/20488693/docs_service_history-1774705478929.jpg?ixlib=js-3.8.0&auto=format&s=98448e3f28ef607d76c5f6fb276dd031'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588328,
'Height': 2834,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8693/20488693/exterior_front_driver-1774776345612.jpg',
'Width': 3779},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1123956,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_driver-1774704800275.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 812983,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_front_passenger-1774704802357.jpg',
'Width': 3218},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822689,
'Height': 2417,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8693/20488693/exterior_rear_passenger-1774704834002.jpg',
'Width': 3222},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1758964,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/8693/20488693/interior_front_seats-1774705200839.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 670478,
'Height': 650,
'OriginUrl': 'https://motorway-photos.imgix.net/8693/20488693/interior_rear_seats-1774776731230.png',
'Width': 720},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633014,
'Height': 1943,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8693/20488693/interior_dashboard-1774777573219.jpg',
'Width': 2591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533938,
'Height': 2647,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8693/20488693/docs_service_history-1774776301507.jpg?ixlib=js-3.8.0&auto=format&s=43f37b5cd2fd7f9f650291c63fd3a981',
'Width': 1985},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_884bf42f-d8ed-54a9-83e9-f268f4487e06/884bf42f-d8ed-54a9-83e9-f268f4487e06_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1235888,
'Height': 2891,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8693/20488693/docs_service_history-1774705478929.jpg?ixlib=js-3.8.0&auto=format&s=98448e3f28ef607d76c5f6fb276dd031',
'Width': 3840}],
'price': 29505,
'price_includes_vat': False,
'registration_date': '2019-11-18',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC90 Rdesign PRO T8 PHEV AWD A',
'transmission': 'automatic',
'trim': 'Rdesign PRO T8 PHEV AWD A',
'vin': 'YV1LFBMTDL1576414',
'year': 2019}
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488693%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [motorway.uk] INFO: Saving data for 20488693: {'created_time': 1774815587.239089, 'last_price_update_time': 1774815587.2391, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488693') HTTP/1.1" 204 0
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 884bf42f-d8ed-54a9-83e9-f268f4487e06 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20465121.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20364ab1-3532-5ae4-b1be-c028ae46ee89 with identifier: 20465121
2026-03-29 20:19:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20364ab1-3532-5ae4-b1be-c028ae46ee89 with scrape type 1
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_front_driver-1774708454438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_driver-1774708454438.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_rear_driver-1774708471706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_driver-1774708471706.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_front_passenger-1774708512198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_passenger-1774708512198.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_rear_passenger-1774708493688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_passenger-1774708493688.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5121%252F20465121%252Finterior_front_seats-1774708895626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5121/20465121/interior_front_seats-1774708895626.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5121%252F20465121%252Finterior_rear_seats-1774708967375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5121/20465121/interior_rear_seats-1774708967375.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5121%252F20465121%252Finterior_dashboard-1774771977524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5121/20465121/interior_dashboard-1774771977524.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Finstrument_cluster-1774708984236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/instrument_cluster-1774708984236.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5121%252F20465121%252Finterior_boot-1774709017737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5121/20465121/interior_boot-1774709017737.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5121%252F20465121%252Fdocs_service_history-1774709202072.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44868919e7a2c0589530394fc9664fcb%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5121/20465121/docs_service_history-1774709202072.jpg?ixlib=js-3.8.0&auto=format&s=44868919e7a2c0589530394fc9664fcb not downloaded yet
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_driver-1774708471706.jpg> (referer: None)
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cec3410>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_rear_driver-1774708471706.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_driver-1774708471706.jpg saved to cache
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5121/20465121/interior_dashboard-1774771977524.jpg> (referer: None)
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_driver-1774708454438.jpg> (referer: None)
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_passenger-1774708493688.jpg> (referer: None)
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_passenger-1774708512198.jpg> (referer: None)
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5121/20465121/interior_front_seats-1774708895626.jpg> (referer: None)
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5121/20465121/interior_rear_seats-1774708967375.jpg> (referer: None)
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5121/20465121/docs_service_history-1774709202072.jpg?ixlib=js-3.8.0&auto=format&s=44868919e7a2c0589530394fc9664fcb> (referer: None)
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05a9d0>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5121%252F20465121%252Finterior_dashboard-1774771977524.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5121/20465121/interior_dashboard-1774771977524.jpg saved to cache
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cec3b50>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_front_driver-1774708454438.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_driver-1774708454438.jpg saved to cache
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4e3d0>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_rear_passenger-1774708493688.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_passenger-1774708493688.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e4a10>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5121%252F20465121%252Fexterior_front_passenger-1774708512198.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_passenger-1774708512198.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cee0690>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5121%252F20465121%252Finterior_front_seats-1774708895626.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5121/20465121/interior_front_seats-1774708895626.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebed910>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5121%252F20465121%252Finterior_rear_seats-1774708967375.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5121/20465121/interior_rear_seats-1774708967375.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d270950>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5121%252F20465121%252Fdocs_service_history-1774709202072.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44868919e7a2c0589530394fc9664fcb') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5121/20465121/docs_service_history-1774709202072.jpg?ixlib=js-3.8.0&auto=format&s=44868919e7a2c0589530394fc9664fcb saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5121/20465121/interior_boot-1774709017737.jpg> (referer: None)
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c407910>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5121%252F20465121%252Finterior_boot-1774709017737.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5121/20465121/interior_boot-1774709017737.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20364ab1-3532-5ae4-b1be-c028ae46ee89
2026-03-29 20:19:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20364ab1-3532-5ae4-b1be-c028ae46ee89, skipping ID generation
2026-03-29 20:19:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20364ab1-3532-5ae4-b1be-c028ae46ee89 with scrape type 1
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20364ab1-3532-5ae4-b1be-c028ae46ee89 sending to next pipeline
2026-03-29 20:19:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 20364ab1-3532-5ae4-b1be-c028ae46ee89, identifier: 20465121
2026-03-29 20:19:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 20364ab1-3532-5ae4-b1be-c028ae46ee89 with identifier: 20465121
2026-03-29 20:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 20364ab1-3532-5ae4-b1be-c028ae46ee89 with identifier: 20465121
2026-03-29 20:19:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 20364ab1-3532-5ae4-b1be-c028ae46ee89 with identifier: 20465121 to the API
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5121/20465121/interior_boot-1774709017737.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '20364ab1-3532-5ae4-b1be-c028ae46ee89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MAK 72',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20465121',
'listing': 'auction',
'location': 'Merseyside Prenton',
'make': 'Audi',
'model': 'RS4',
'odometer': 14500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1498668,
'Height': 2257,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_driver-1774708454438.jpg',
'Width': 3009},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1199144,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_driver-1774708471706.jpg',
'Width': 3267},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1597489,
'Height': 2505,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_front_passenger-1774708512198.jpg',
'Width': 3340},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2090625,
'Height': 2742,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5121/20465121/exterior_rear_passenger-1774708493688.jpg',
'Width': 3656},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2965895,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5121/20465121/interior_front_seats-1774708895626.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443405,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5121/20465121/interior_rear_seats-1774708967375.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 936332,
'Height': 1949,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5121/20465121/interior_dashboard-1774771977524.jpg',
'Width': 2599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3181761,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5121/20465121/interior_boot-1774709017737.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20364ab1-3532-5ae4-b1be-c028ae46ee89/20364ab1-3532-5ae4-b1be-c028ae46ee89_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590886,
'Height': 2987,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5121/20465121/docs_service_history-1774709202072.jpg?ixlib=js-3.8.0&auto=format&s=44868919e7a2c0589530394fc9664fcb',
'Width': 2015}],
'price': 58449,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi RS 4 Carbon Black TFSI Quat A',
'transmission': 'automatic',
'trim': 'RS 4 Carbon Black TFSI Quat A',
'vin': 'WUAZZZF41RA900668',
'year': 2024}
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465121%27 HTTP/1.1" 200 None
2026-03-29 20:19:50 [motorway.uk] INFO: Saving data for 20465121: {'created_time': 1774815590.288454, 'last_price_update_time': 1774815590.288469, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20465121') HTTP/1.1" 204 0
2026-03-29 20:19:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20415455.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19f7e2e-257d-51d2-b48f-d49d91c90fe7 with identifier: 20415455
2026-03-29 20:19:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7 with scrape type 1
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_front_driver-1774713048044.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_driver-1774713048044.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_rear_driver-1774713058619.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_driver-1774713058619.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_front_passenger-1774713159340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_passenger-1774713159340.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_rear_passenger-1774713129231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_passenger-1774713129231.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5455%252F20415455%252Finterior_front_seats-1774713781852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5455/20415455/interior_front_seats-1774713781852.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5455%252F20415455%252Finterior_rear_seats-1774713796776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5455/20415455/interior_rear_seats-1774713796776.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Finterior_dashboard-1774713828865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/interior_dashboard-1774713828865.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Finstrument_cluster-1774713866613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/instrument_cluster-1774713866613.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5455%252F20415455%252Finterior_boot-1774714071678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5455/20415455/interior_boot-1774714071678.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5455%252F20415455%252Fdocs_service_history-1774714679059.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b4e26b61674bcd72f1f50f4114895f7%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5455/20415455/docs_service_history-1774714679059.jpg?ixlib=js-3.8.0&auto=format&s=4b4e26b61674bcd72f1f50f4114895f7 not downloaded yet
2026-03-29 20:19:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_driver-1774713058619.jpg> (referer: None)
2026-03-29 20:19:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_driver-1774713048044.jpg> (referer: None)
2026-03-29 20:19:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_passenger-1774713129231.jpg> (referer: None)
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d787450>
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_rear_driver-1774713058619.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_driver-1774713058619.jpg saved to cache
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecdc90>
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_front_driver-1774713048044.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_driver-1774713048044.jpg saved to cache
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1b010>
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_rear_passenger-1774713129231.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_passenger-1774713129231.jpg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_passenger-1774713159340.jpg> (referer: None)
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5455/20415455/docs_service_history-1774714679059.jpg?ixlib=js-3.8.0&auto=format&s=4b4e26b61674bcd72f1f50f4114895f7> (referer: None)
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5455/20415455/interior_rear_seats-1774713796776.jpg> (referer: None)
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5455/20415455/interior_boot-1774714071678.jpg> (referer: None)
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5455/20415455/interior_front_seats-1774713781852.jpg> (referer: None)
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2b2450>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5455%252F20415455%252Fexterior_front_passenger-1774713159340.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_passenger-1774713159340.jpg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e928d50>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5455%252F20415455%252Fdocs_service_history-1774714679059.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b4e26b61674bcd72f1f50f4114895f7') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5455/20415455/docs_service_history-1774714679059.jpg?ixlib=js-3.8.0&auto=format&s=4b4e26b61674bcd72f1f50f4114895f7 saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc21fbef10>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5455%252F20415455%252Finterior_rear_seats-1774713796776.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5455/20415455/interior_rear_seats-1774713796776.jpg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2b3f50>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5455%252F20415455%252Finterior_boot-1774714071678.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5455/20415455/interior_boot-1774714071678.jpg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecc250>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5455%252F20415455%252Finterior_front_seats-1774713781852.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5455/20415455/interior_front_seats-1774713781852.jpg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:19:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e19f7e2e-257d-51d2-b48f-d49d91c90fe7 with identifier: 20415455
2026-03-29 20:19:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e19f7e2e-257d-51d2-b48f-d49d91c90fe7 with identifier: 20415455
2026-03-29 20:19:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e19f7e2e-257d-51d2-b48f-d49d91c90fe7 with identifier: 20415455 to the API
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:57 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e19f7e2e-257d-51d2-b48f-d49d91c90fe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MA20 GYP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20415455',
'listing': 'auction',
'location': 'Swansea Swansea',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_driver-1774713048044.jpg',
'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_driver-1774713058619.jpg',
'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_passenger-1774713159340.jpg',
'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_passenger-1774713129231.jpg',
'https://motorway-photos.imgix.net/5455/20415455/interior_front_seats-1774713781852.jpg',
'https://motorway-photos.imgix.net/5455/20415455/interior_rear_seats-1774713796776.jpg',
'https://motorway-photos-redacted.imgix.net/5455/20415455/interior_dashboard-1774713828865.jpg',
'https://motorway-photos-redacted.imgix.net/5455/20415455/instrument_cluster-1774713866613.jpg',
'https://motorway-photos.imgix.net/5455/20415455/interior_boot-1774714071678.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5455/20415455/docs_service_history-1774714679059.jpg?ixlib=js-3.8.0&auto=format&s=4b4e26b61674bcd72f1f50f4114895f7'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688003,
'Height': 2688,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_driver-1774713048044.jpg',
'Width': 3584},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1554189,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_driver-1774713058619.jpg',
'Width': 3751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2228441,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_front_passenger-1774713159340.jpg',
'Width': 3967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1860546,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5455/20415455/exterior_rear_passenger-1774713129231.jpg',
'Width': 3967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3146890,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5455/20415455/interior_front_seats-1774713781852.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2777294,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5455/20415455/interior_rear_seats-1774713796776.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2723753,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5455/20415455/interior_boot-1774714071678.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e19f7e2e-257d-51d2-b48f-d49d91c90fe7/e19f7e2e-257d-51d2-b48f-d49d91c90fe7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250981,
'Height': 2532,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5455/20415455/docs_service_history-1774714679059.jpg?ixlib=js-3.8.0&auto=format&s=4b4e26b61674bcd72f1f50f4114895f7',
'Width': 1170}],
'price': 23279,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Sport HSE SDV6 A',
'transmission': 'automatic',
'trim': 'Sport HSE SDV6 A',
'vin': 'SALWA2AK1LA731126',
'year': 2020}
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720415455%27 HTTP/1.1" 200 None
2026-03-29 20:19:57 [motorway.uk] INFO: Saving data for 20415455: {'created_time': 1774815597.169952, 'last_price_update_time': 1774815597.169968, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20415455') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item e19f7e2e-257d-51d2-b48f-d49d91c90fe7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.469(s), this was the 1st time calling it.
2026-03-29 20:20:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.339298178462821 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.235(s), this was the 1st time calling it.
2026-03-29 20:20:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.446493496041713 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:05 [scrapy.extensions.logstats] INFO: Crawled 123 pages (at 12 pages/min), scraped 108 items (at 19 items/min)
2026-03-29 20:20:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=432&page=12&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20168160
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720168160%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 20168160: 1
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 19750033
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 19427127
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 18209819
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 18301360
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718301360%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 18301360: 1
2026-03-29 20:20:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20315758
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720315758%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 20315758: 1
2026-03-29 20:20:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20303235
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20491229
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 13358851
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20494032
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494032%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 20494032: 1
2026-03-29 20:20:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 18839642
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20490324
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 19350653
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 13711845
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 14441433
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714441433%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 14441433: 1
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20499741
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499741%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 20499741: 1
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 10678898
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 19016165
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20458519
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20500024
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20461118
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 11411855
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20459543
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 18543563
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718543563%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 18543563: 1
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20269831
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20341046
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720341046%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Scrape type for 20341046: 1
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 20265542
2026-03-29 20:20:10 [motorway.uk] INFO: Found listing with ID: 10211430
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710211430%27 HTTP/1.1" 200 None
2026-03-29 20:20:11 [motorway.uk] INFO: Scrape type for 10211430: 1
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 20484735
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 20488534
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 1773065
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 14164507
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 19886114
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 20414483
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 19235402
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719235402%27 HTTP/1.1" 200 None
2026-03-29 20:20:11 [motorway.uk] INFO: Scrape type for 19235402: 1
2026-03-29 20:20:11 [motorway.uk] INFO: Found listing with ID: 20488258
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488258%27 HTTP/1.1" 200 None
2026-03-29 20:20:11 [motorway.uk] INFO: Scrape type for 20488258: 1
2026-03-29 20:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20168160.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50e14113-f72c-5848-a6cb-6ad132cda375 with identifier: 20168160
2026-03-29 20:20:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50e14113-f72c-5848-a6cb-6ad132cda375 with scrape type 1
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50e14113-f72c-5848-a6cb-6ad132cda375
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8160%252F20168160%252F20168160-exterior_front_driver-modified-1773657466474.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8160/20168160/20168160-exterior_front_driver-modified-1773657466474.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8160%252F20168160%252Fexterior_rear_driver-1772989638260.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8160/20168160/exterior_rear_driver-1772989638260.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8160%252F20168160%252Fexterior_front_passenger-1772989606778.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8160/20168160/exterior_front_passenger-1772989606778.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8160%252F20168160%252Fexterior_rear_passenger-1772989622113.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8160/20168160/exterior_rear_passenger-1772989622113.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8160%252F20168160%252Finterior_front_seats-1772989689482.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8160/20168160/interior_front_seats-1772989689482.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8160%252F20168160%252Finterior_rear_seats-1772989725091.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8160/20168160/interior_rear_seats-1772989725091.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8160%252F20168160%252Finterior_dashboard-1772989758679.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8160/20168160/interior_dashboard-1772989758679.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8160%252F20168160%252Finstrument_cluster-1772989830638.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8160/20168160/instrument_cluster-1772989830638.jpeg already downloaded
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8160%252F20168160%252Finterior_boot-1772989770352.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8160/20168160/interior_boot-1772989770352.jpeg not downloaded yet
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8160%252F20168160%252Fdocs_service_history-1773606593729.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D01e1fd66d05e18abc3870328a37d7386%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8160/20168160/docs_service_history-1773606593729.jpeg?ixlib=js-3.8.0&auto=format&s=01e1fd66d05e18abc3870328a37d7386 already downloaded
2026-03-29 20:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20315758.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1 with identifier: 20315758
2026-03-29 20:20:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1 with scrape type 1
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5758%252F20315758%252Fexterior_front_driver-1773939358784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_front_driver-1773939358784.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5758%252F20315758%252Fexterior_rear_driver-1773939375983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_rear_driver-1773939375983.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5758%252F20315758%252Fexterior_front_passenger-1773939410563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_front_passenger-1773939410563.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5758%252F20315758%252Fexterior_rear_passenger-1773939392585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_rear_passenger-1773939392585.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5758%252F20315758%252Finterior_front_seats-1773939718889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5758/20315758/interior_front_seats-1773939718889.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5758%252F20315758%252Finterior_rear_seats-1773939733359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5758/20315758/interior_rear_seats-1773939733359.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5758%252F20315758%252Finterior_dashboard-1773939866023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5758/20315758/interior_dashboard-1773939866023.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5758%252F20315758%252Finstrument_cluster-1773939800678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5758/20315758/instrument_cluster-1773939800678.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5758%252F20315758%252Finterior_boot-1773939795676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5758/20315758/interior_boot-1773939795676.jpg already downloaded
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5758%252F20315758%252Fdocs_service_history-1773939964424.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D71442adf65c382d2496777354af2d417%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5758/20315758/docs_service_history-1773939964424.jpg?ixlib=js-3.8.0&auto=format&s=71442adf65c382d2496777354af2d417 already downloaded
2026-03-29 20:20:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1, identifier: 20315758
2026-03-29 20:20:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1 with identifier: 20315758
2026-03-29 20:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1 with identifier: 20315758
2026-03-29 20:20:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1 with identifier: 20315758 to the API
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20315758.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AO67 KWT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20315758',
'listing': 'auction',
'location': 'Greater Manchester Bury',
'make': 'Audi',
'model': 'A5',
'odometer': 69250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_front_driver-1773939358784.jpg',
'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_rear_driver-1773939375983.jpg',
'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_front_passenger-1773939410563.jpg',
'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_rear_passenger-1773939392585.jpg',
'https://motorway-photos.imgix.net/5758/20315758/interior_front_seats-1773939718889.jpg',
'https://motorway-photos.imgix.net/5758/20315758/interior_rear_seats-1773939733359.jpg',
'https://motorway-photos-redacted.imgix.net/5758/20315758/interior_dashboard-1773939866023.jpg',
'https://motorway-photos-redacted.imgix.net/5758/20315758/instrument_cluster-1773939800678.jpg',
'https://motorway-photos.imgix.net/5758/20315758/interior_boot-1773939795676.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5758/20315758/docs_service_history-1773939964424.jpg?ixlib=js-3.8.0&auto=format&s=71442adf65c382d2496777354af2d417'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989058,
'Height': 2763,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_front_driver-1773939358784.jpg',
'Width': 3684},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1805858,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_rear_driver-1773939375983.jpg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1470041,
'Height': 2607,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_front_passenger-1773939410563.jpg',
'Width': 3476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1181734,
'Height': 2583,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5758/20315758/exterior_rear_passenger-1773939392585.jpg',
'Width': 3444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3261449,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5758/20315758/interior_front_seats-1773939718889.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3358320,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5758/20315758/interior_rear_seats-1773939733359.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1731874,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5758/20315758/interior_dashboard-1773939866023.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2508036,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5758/20315758/instrument_cluster-1773939800678.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2781367,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5758/20315758/interior_boot-1773939795676.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1/c104cf4c-2e49-5e0e-aaf1-7c2f164dbdc1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1048731,
'Height': 844,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5758/20315758/docs_service_history-1773939964424.jpg?ixlib=js-3.8.0&auto=format&s=71442adf65c382d2496777354af2d417',
'Width': 1801}],
'price': 24621,
'price_includes_vat': False,
'registration_date': '2017-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi RS 5 TFSI QUATTRO AUTO',
'transmission': 'automatic',
'trim': 'RS 5 TFSI QUATTRO AUTO',
'vin': 'WUAZZZF55JA900296',
'year': 2017}
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720315758%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [motorway.uk] INFO: Saving data for 20315758: {'created_time': 1774815618.38644, 'last_price_update_time': 1774815618.38645, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20315758') HTTP/1.1" 204 0
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8160/20168160/interior_boot-1772989770352.jpeg> (referer: None)
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\x04i\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xbe,\x001\xf9\xcb\x00\x00\x00\x00'
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc142d8b10>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8160%252F20168160%252Finterior_boot-1772989770352.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8160/20168160/interior_boot-1772989770352.jpeg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50e14113-f72c-5848-a6cb-6ad132cda375
2026-03-29 20:20:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50e14113-f72c-5848-a6cb-6ad132cda375, skipping ID generation
2026-03-29 20:20:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50e14113-f72c-5848-a6cb-6ad132cda375 with scrape type 1
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50e14113-f72c-5848-a6cb-6ad132cda375 sending to next pipeline
2026-03-29 20:20:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 50e14113-f72c-5848-a6cb-6ad132cda375, identifier: 20168160
2026-03-29 20:20:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 50e14113-f72c-5848-a6cb-6ad132cda375 with identifier: 20168160
2026-03-29 20:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 50e14113-f72c-5848-a6cb-6ad132cda375 with identifier: 20168160
2026-03-29 20:20:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 50e14113-f72c-5848-a6cb-6ad132cda375 with identifier: 20168160 to the API
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8160/20168160/interior_boot-1772989770352.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '50e14113-f72c-5848-a6cb-6ad132cda375',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT67 ZLE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20168160',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 15643,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468938,
'Height': 2222,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8160/20168160/20168160-exterior_front_driver-modified-1773657466474.jpeg',
'Width': 2963},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1126959,
'Height': 2183,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8160/20168160/exterior_rear_driver-1772989638260.jpeg',
'Width': 2911},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 869864,
'Height': 1922,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8160/20168160/exterior_front_passenger-1772989606778.jpeg',
'Width': 2563},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1287545,
'Height': 2284,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8160/20168160/exterior_rear_passenger-1772989622113.jpeg',
'Width': 3045},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3890149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8160/20168160/interior_front_seats-1772989689482.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3638293,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8160/20168160/interior_rear_seats-1772989725091.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1661168,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8160/20168160/interior_dashboard-1772989758679.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2838799,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8160/20168160/instrument_cluster-1772989830638.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3457685,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8160/20168160/interior_boot-1772989770352.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e14113-f72c-5848-a6cb-6ad132cda375/50e14113-f72c-5848-a6cb-6ad132cda375_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1236380,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8160/20168160/docs_service_history-1773606593729.jpeg?ixlib=js-3.8.0&auto=format&s=01e1fd66d05e18abc3870328a37d7386',
'Width': 3024}],
'price': 11294,
'price_includes_vat': False,
'registration_date': '2017-09-19',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match Edition TSI S-A',
'transmission': 'automatic',
'trim': 'Match Edition TSI S-A',
'vin': 'WVWZZZ6RZHU091688',
'year': 2017}
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720168160%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [motorway.uk] INFO: Saving data for 20168160: {'created_time': 1774815619.295201, 'last_price_update_time': 1774815619.295212, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20168160') HTTP/1.1" 204 0
2026-03-29 20:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18301360.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20031424.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7fcae78-88b9-5df8-83c1-03e4f382a227 with identifier: 18301360
2026-03-29 20:20:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7fcae78-88b9-5df8-83c1-03e4f382a227 with scrape type 1
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_front_driver-default-1774689446657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_driver-default-1774689446657.jpg not downloaded yet
2026-03-29 20:20:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe with identifier: 20031424
2026-03-29 20:20:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe with scrape type 1
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1424%252F20031424%252Fexterior_front_driver-1772530987181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_front_driver-1772530987181.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1424%252F20031424%252Fexterior_rear_driver-1772531014530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_rear_driver-1772531014530.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1424%252F20031424%252Fexterior_front_passenger-1772531045541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_front_passenger-1772531045541.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1424%252F20031424%252Fexterior_rear_passenger-1772531083499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_rear_passenger-1772531083499.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1424%252F20031424%252Finterior_front_seats-1772531419644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1424/20031424/interior_front_seats-1772531419644.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1424%252F20031424%252Finterior_rear_seats-1772531443679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1424/20031424/interior_rear_seats-1772531443679.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1424%252F20031424%252Finterior_dashboard-1772614400858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1424/20031424/interior_dashboard-1772614400858.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1424%252F20031424%252Finstrument_cluster-1772531558193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1424/20031424/instrument_cluster-1772531558193.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1424%252F20031424%252Finterior_boot-1772531469321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1424/20031424/interior_boot-1772531469321.jpg already downloaded
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1424%252F20031424%252Fwheels_front_driver-1772531140167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1424/20031424/wheels_front_driver-1772531140167.jpg already downloaded
2026-03-29 20:20:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe, identifier: 20031424
2026-03-29 20:20:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe with identifier: 20031424
2026-03-29 20:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe with identifier: 20031424
2026-03-29 20:20:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe with identifier: 20031424 to the API
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20031424.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'dd5c9a18-c9e8-55e8-a508-f4fc5e94bbfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD74 CXC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20031424',
'listing': 'auction',
'location': 'Suffolk Stowmarket',
'make': 'Volkswagen',
'model': 'Transporter',
'odometer': 8600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_front_driver-1772530987181.jpg',
'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_rear_driver-1772531014530.jpg',
'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_front_passenger-1772531045541.jpg',
'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_rear_passenger-1772531083499.jpg',
'https://motorway-photos.imgix.net/1424/20031424/interior_front_seats-1772531419644.jpg',
'https://motorway-photos.imgix.net/1424/20031424/interior_rear_seats-1772531443679.jpg',
'https://motorway-photos-modified.imgix.net/1424/20031424/interior_dashboard-1772614400858.jpg',
'https://motorway-photos-redacted.imgix.net/1424/20031424/instrument_cluster-1772531558193.jpg',
'https://motorway-photos.imgix.net/1424/20031424/interior_boot-1772531469321.jpg',
'https://motorway-photos-redacted.imgix.net/1424/20031424/wheels_front_driver-1772531140167.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1270971,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_front_driver-1772530987181.jpg',
'Width': 3102},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1298544,
'Height': 2131,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_rear_driver-1772531014530.jpg',
'Width': 2841},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504172,
'Height': 2340,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_front_passenger-1772531045541.jpg',
'Width': 3120},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1525104,
'Height': 2300,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1424/20031424/exterior_rear_passenger-1772531083499.jpg',
'Width': 3067},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4854316,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1424/20031424/interior_front_seats-1772531419644.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5021502,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1424/20031424/interior_rear_seats-1772531443679.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2513401,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1424/20031424/interior_dashboard-1772614400858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3388129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1424/20031424/instrument_cluster-1772531558193.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3388665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1424/20031424/interior_boot-1772531469321.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a76ed2-4573-5ad5-aeb2-5ccffa25c219/05a76ed2-4573-5ad5-aeb2-5ccffa25c219_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115484,
'Height': 2310,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1424/20031424/wheels_front_driver-1772531140167.jpg',
'Width': 3080}],
'price': 37500,
'price_includes_vat': False,
'registration_date': '2024-12-20',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Transporter T30 Highline TDI',
'transmission': 'manual',
'trim': 'T30 Highline TDI',
'vin': 'WV1ZZZ7HZRH086136',
'year': 2024}
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720031424%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [motorway.uk] INFO: Saving data for 20031424: {'created_time': 1774815620.138258, 'last_price_update_time': 1774815620.138269, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20031424') HTTP/1.1" 204 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_rear_driver-default-1774689448079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_driver-default-1774689448079.jpg not downloaded yet
2026-03-29 20:20:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.049(s), this was the 1st time calling it.
2026-03-29 20:20:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.492267600246603 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_front_passenger-default-1774689455011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_passenger-default-1774689455011.jpg not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_rear_passenger-default-1774689447722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_passenger-default-1774689447722.jpg not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1360%252F18301360%252F18301360-interior_front_seats-default-1774691049553.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1360/18301360/18301360-interior_front_seats-default-1774691049553.jpg not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-interior_dashboard-default-1774689497516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-interior_dashboard-default-1774689497516.jpg not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-instrument_cluster-default-1774689636055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-instrument_cluster-default-1774689636055.jpg not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1360%252F18301360%252F18301360-interior_boot-default-1774689483862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1360/18301360/18301360-interior_boot-default-1774689483862.jpg not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1360%252F18301360%252F18301360-docs_service_history-default-1774689570927.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ccbee4b043a5985b726068e5a806e65%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689570927.jpg?ixlib=js-3.8.0&auto=format&s=5ccbee4b043a5985b726068e5a806e65 not downloaded yet
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1360%252F18301360%252F18301360-docs_service_history-default-1774689582837.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D005b91d0899a88cd1091d7b7f09dab68%27 HTTP/1.1" 200 None
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689582837.jpg?ixlib=js-3.8.0&auto=format&s=005b91d0899a88cd1091d7b7f09dab68 not downloaded yet
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_driver-default-1774689446657.jpg> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_passenger-default-1774689455011.jpg> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_driver-default-1774689448079.jpg> (referer: None)
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e926910>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_front_driver-default-1774689446657.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_driver-default-1774689446657.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef7e10>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_front_passenger-default-1774689455011.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_passenger-default-1774689455011.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c232b50>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_rear_driver-default-1774689448079.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_driver-default-1774689448079.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14441433.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689582837.jpg?ixlib=js-3.8.0&auto=format&s=005b91d0899a88cd1091d7b7f09dab68> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689570927.jpg?ixlib=js-3.8.0&auto=format&s=5ccbee4b043a5985b726068e5a806e65> (referer: None)
2026-03-29 20:20:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d with identifier: 14441433
2026-03-29 20:20:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d with scrape type 1
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_front_driver-1774623415013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_driver-1774623415013.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_rear_driver-1774623405802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_rear_driver-1774623405802.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_front_passenger-1774623390287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_passenger-1774623390287.jpg not downloaded yet
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2aea10>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1360%252F18301360%252F18301360-docs_service_history-default-1774689582837.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D005b91d0899a88cd1091d7b7f09dab68') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689582837.jpg?ixlib=js-3.8.0&auto=format&s=005b91d0899a88cd1091d7b7f09dab68 saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec39290>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1360%252F18301360%252F18301360-docs_service_history-default-1774689570927.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ccbee4b043a5985b726068e5a806e65') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689570927.jpg?ixlib=js-3.8.0&auto=format&s=5ccbee4b043a5985b726068e5a806e65 saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_rear_passenger-1774623394057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_rear_passenger-1774623394057.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1433%252F14441433%252Finterior_front_seats-1774623763932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1433/14441433/interior_front_seats-1774623763932.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1433%252F14441433%252Finterior_rear_seats-1774623973811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1433/14441433/interior_rear_seats-1774623973811.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Finterior_dashboard-1774623895007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/interior_dashboard-1774623895007.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1433%252F14441433%252Finstrument_cluster-1774628901305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1433/14441433/instrument_cluster-1774628901305.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1433%252F14441433%252Finterior_boot-1774623805879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1433/14441433/interior_boot-1774623805879.jpg not downloaded yet
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1433%252F14441433%252Fdocs_service_history-1774628993549.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6b94eb7dd9f7031d9745dc63a5710365%27 HTTP/1.1" 200 None
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1433/14441433/docs_service_history-1774628993549.jpg?ixlib=js-3.8.0&auto=format&s=6b94eb7dd9f7031d9745dc63a5710365 not downloaded yet
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-instrument_cluster-default-1774689636055.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-interior_dashboard-default-1774689497516.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1360/18301360/18301360-interior_boot-default-1774689483862.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1433/14441433/docs_service_history-1774628993549.jpg?ixlib=js-3.8.0&auto=format&s=6b94eb7dd9f7031d9745dc63a5710365> (referer: None)
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad81d0>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-instrument_cluster-default-1774689636055.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-instrument_cluster-default-1774689636055.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e00bcd0>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-interior_dashboard-default-1774689497516.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-interior_dashboard-default-1774689497516.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c257190>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1360%252F18301360%252F18301360-interior_boot-default-1774689483862.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1360/18301360/18301360-interior_boot-default-1774689483862.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf06510>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1433%252F14441433%252Fdocs_service_history-1774628993549.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6b94eb7dd9f7031d9745dc63a5710365') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1433/14441433/docs_service_history-1774628993549.jpg?ixlib=js-3.8.0&auto=format&s=6b94eb7dd9f7031d9745dc63a5710365 saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_rear_passenger-1774623394057.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20499741.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d133f10>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_rear_passenger-1774623394057.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_rear_passenger-1774623394057.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d727c35e-19cb-59bb-88d8-6ff30087d16e with identifier: 20499741
2026-03-29 20:20:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d727c35e-19cb-59bb-88d8-6ff30087d16e with scrape type 1
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_front_driver-1774779140680.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_driver-1774779140680.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_rear_driver-1774779169284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_driver-1774779169284.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_front_passenger-1774779216269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_passenger-1774779216269.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_rear_passenger-1774779190188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_passenger-1774779190188.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9741%252F20499741%252Finterior_front_seats-1774779559433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9741/20499741/interior_front_seats-1774779559433.jpg not downloaded yet
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1433/14441433/instrument_cluster-1774628901305.jpg> (referer: None)
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9741%252F20499741%252Finterior_rear_seats-1774779579944.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9741/20499741/interior_rear_seats-1774779579944.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9741%252F20499741%252F20499741-interior_dashboard-modified-1774779966901.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9741/20499741/20499741-interior_dashboard-modified-1774779966901.jpeg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Finstrument_cluster-1774779658930.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/instrument_cluster-1774779658930.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9741%252F20499741%252Finterior_boot-1774779638091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9741/20499741/interior_boot-1774779638091.jpg not downloaded yet
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9741%252F20499741%252Fdocs_service_history-1774779725882.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6df3f7e236a90c76bc3c6221932aaf34%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9741/20499741/docs_service_history-1774779725882.jpg?ixlib=js-3.8.0&auto=format&s=6df3f7e236a90c76bc3c6221932aaf34 not downloaded yet
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e929510>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1433%252F14441433%252Finstrument_cluster-1774628901305.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1433/14441433/instrument_cluster-1774628901305.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1433/14441433/interior_dashboard-1774623895007.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1433/14441433/interior_rear_seats-1774623973811.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1433/14441433/interior_boot-1774623805879.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1433/14441433/interior_front_seats-1774623763932.jpg> (referer: None)
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d584650>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Finterior_dashboard-1774623895007.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/interior_dashboard-1774623895007.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7428d0>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1433%252F14441433%252Finterior_rear_seats-1774623973811.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1433/14441433/interior_rear_seats-1774623973811.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf7190>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1433%252F14441433%252Finterior_boot-1774623805879.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1433/14441433/interior_boot-1774623805879.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec059d0>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1433%252F14441433%252Finterior_front_seats-1774623763932.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1433/14441433/interior_front_seats-1774623763932.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_passenger-1774779190188.jpg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9741/20499741/docs_service_history-1774779725882.jpg?ixlib=js-3.8.0&auto=format&s=6df3f7e236a90c76bc3c6221932aaf34> (referer: None)
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c654150>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_rear_passenger-1774779190188.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_passenger-1774779190188.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22e890>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9741%252F20499741%252Fdocs_service_history-1774779725882.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6df3f7e236a90c76bc3c6221932aaf34') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9741/20499741/docs_service_history-1774779725882.jpg?ixlib=js-3.8.0&auto=format&s=6df3f7e236a90c76bc3c6221932aaf34 saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9741/20499741/20499741-interior_dashboard-modified-1774779966901.jpeg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9741/20499741/interior_boot-1774779638091.jpg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9741/20499741/instrument_cluster-1774779658930.jpg> (referer: None)
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c404bd0>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9741%252F20499741%252F20499741-interior_dashboard-modified-1774779966901.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9741/20499741/20499741-interior_dashboard-modified-1774779966901.jpeg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c233750>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9741%252F20499741%252Finterior_boot-1774779638091.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9741/20499741/interior_boot-1774779638091.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c404590>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Finstrument_cluster-1774779658930.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/instrument_cluster-1774779658930.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9741/20499741/interior_rear_seats-1774779579944.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10211430.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_passenger-1774779216269.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9741/20499741/interior_front_seats-1774779559433.jpg> (referer: None)
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2334d0>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9741%252F20499741%252Finterior_rear_seats-1774779579944.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9741/20499741/interior_rear_seats-1774779579944.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec479b8-6b5f-58e5-8284-5d0bf7123781 with identifier: 10211430
2026-03-29 20:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec479b8-6b5f-58e5-8284-5d0bf7123781 with scrape type 1
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_front_driver-1774692188458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_front_driver-1774692188458.jpg not downloaded yet
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec05450>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_front_passenger-1774779216269.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_passenger-1774779216269.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceab410>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9741%252F20499741%252Finterior_front_seats-1774779559433.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9741/20499741/interior_front_seats-1774779559433.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_rear_driver-1774692212060.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_driver-1774692212060.jpg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_front_passenger-1774692234573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_front_passenger-1774692234573.jpg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_rear_passenger-1774692222328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_passenger-1774692222328.jpg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1430%252F10211430%252Finterior_front_seats-1774692525313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1430/10211430/interior_front_seats-1774692525313.jpg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1430%252F10211430%252Finterior_rear_seats-1774692698848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1430/10211430/interior_rear_seats-1774692698848.jpg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Finterior_dashboard-1774692577457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/interior_dashboard-1774692577457.jpg not downloaded yet
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_passenger-1774623390287.jpg> (referer: None)
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1430%252F10211430%252Finterior_boot-1774692575716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1430/10211430/interior_boot-1774692575716.jpg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1430%252F10211430%252Fdocs_service_history-1774693355324.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da46201a8dd7f22bc7c3d0e795d1e13ec%27 HTTP/1.1" 200 None
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1430/10211430/docs_service_history-1774693355324.jpg?ixlib=js-3.8.0&auto=format&s=a46201a8dd7f22bc7c3d0e795d1e13ec not downloaded yet
2026-03-29 20:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_driver-1774779140680.jpg> (referer: None)
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fwheels_front_driver-1774692265392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/wheels_front_driver-1774692265392.jpg not downloaded yet
2026-03-29 20:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_driver-1774779169284.jpg> (referer: None)
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad8950>
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_front_passenger-1774623390287.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_passenger-1774623390287.jpg saved to cache
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d572010>
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_front_driver-1774779140680.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_driver-1774779140680.jpg saved to cache
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06b590>
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9741%252F20499741%252Fexterior_rear_driver-1774779169284.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_driver-1774779169284.jpg saved to cache
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d727c35e-19cb-59bb-88d8-6ff30087d16e
2026-03-29 20:20:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d727c35e-19cb-59bb-88d8-6ff30087d16e, skipping ID generation
2026-03-29 20:20:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d727c35e-19cb-59bb-88d8-6ff30087d16e with scrape type 1
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d727c35e-19cb-59bb-88d8-6ff30087d16e sending to next pipeline
2026-03-29 20:20:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d727c35e-19cb-59bb-88d8-6ff30087d16e, identifier: 20499741
2026-03-29 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d727c35e-19cb-59bb-88d8-6ff30087d16e with identifier: 20499741
2026-03-29 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d727c35e-19cb-59bb-88d8-6ff30087d16e with identifier: 20499741
2026-03-29 20:20:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d727c35e-19cb-59bb-88d8-6ff30087d16e with identifier: 20499741 to the API
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_driver-1774779169284.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd727c35e-19cb-59bb-88d8-6ff30087d16e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MR10 LVR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20499741',
'listing': 'auction',
'location': 'Newport Newport',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 56773,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1332392,
'Height': 2403,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_driver-1774779140680.jpg',
'Width': 3204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1316714,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_driver-1774779169284.jpg',
'Width': 3159},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1869552,
'Height': 2991,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_front_passenger-1774779216269.jpg',
'Width': 3988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1698918,
'Height': 2908,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9741/20499741/exterior_rear_passenger-1774779190188.jpg',
'Width': 3877},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4670927,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9741/20499741/interior_front_seats-1774779559433.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3297408,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9741/20499741/interior_rear_seats-1774779579944.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3064986,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9741/20499741/20499741-interior_dashboard-modified-1774779966901.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2997679,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9741/20499741/instrument_cluster-1774779658930.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3947950,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9741/20499741/interior_boot-1774779638091.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727c35e-19cb-59bb-88d8-6ff30087d16e/d727c35e-19cb-59bb-88d8-6ff30087d16e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3727853,
'Height': 3209,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9741/20499741/docs_service_history-1774779725882.jpg?ixlib=js-3.8.0&auto=format&s=6df3f7e236a90c76bc3c6221932aaf34',
'Width': 2270}],
'price': 12648,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque R-DYNAMIC S D A',
'transmission': 'automatic',
'trim': 'Evoque R-DYNAMIC S D A',
'vin': 'SALZA2AN3LH056538',
'year': 2019}
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499741%27 HTTP/1.1" 200 None
2026-03-29 20:20:26 [motorway.uk] INFO: Saving data for 20499741: {'created_time': 1774815626.22909, 'last_price_update_time': 1774815626.229103, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20499741') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_driver-1774692212060.jpg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1430/10211430/docs_service_history-1774693355324.jpg?ixlib=js-3.8.0&auto=format&s=a46201a8dd7f22bc7c3d0e795d1e13ec> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1430/10211430/wheels_front_driver-1774692265392.jpg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1430/10211430/interior_dashboard-1774692577457.jpg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1430/10211430/interior_boot-1774692575716.jpg> (referer: None)
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item dec479b8-6b5f-58e5-8284-5d0bf7123781 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cada410>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_rear_driver-1774692212060.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_driver-1774692212060.jpg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca70c90>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1430%252F10211430%252Fdocs_service_history-1774693355324.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da46201a8dd7f22bc7c3d0e795d1e13ec') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1430/10211430/docs_service_history-1774693355324.jpg?ixlib=js-3.8.0&auto=format&s=a46201a8dd7f22bc7c3d0e795d1e13ec saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad9610>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fwheels_front_driver-1774692265392.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/wheels_front_driver-1774692265392.jpg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0713d0>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Finterior_dashboard-1774692577457.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/interior_dashboard-1774692577457.jpg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb00790>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1430%252F10211430%252Finterior_boot-1774692575716.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1430/10211430/interior_boot-1774692575716.jpg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_passenger-1774692222328.jpg> (referer: None)
2026-03-29 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_front_passenger-1774692234573.jpg> (referer: None)
2026-03-29 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1430/10211430/interior_rear_seats-1774692698848.jpg> (referer: None)
2026-03-29 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1430/10211430/interior_front_seats-1774692525313.jpg> (referer: None)
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c254290>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_rear_passenger-1774692222328.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_passenger-1774692222328.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e927b90>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1430%252F10211430%252Fexterior_front_passenger-1774692234573.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_front_passenger-1774692234573.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e051fd0>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1430%252F10211430%252Finterior_rear_seats-1774692698848.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1430/10211430/interior_rear_seats-1774692698848.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ec290>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1430%252F10211430%252Finterior_front_seats-1774692525313.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1430/10211430/interior_front_seats-1774692525313.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dec479b8-6b5f-58e5-8284-5d0bf7123781
2026-03-29 20:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dec479b8-6b5f-58e5-8284-5d0bf7123781, skipping ID generation
2026-03-29 20:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec479b8-6b5f-58e5-8284-5d0bf7123781 with scrape type 1
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dec479b8-6b5f-58e5-8284-5d0bf7123781 sending to next pipeline
2026-03-29 20:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dec479b8-6b5f-58e5-8284-5d0bf7123781, identifier: 10211430
2026-03-29 20:20:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dec479b8-6b5f-58e5-8284-5d0bf7123781 with identifier: 10211430
2026-03-29 20:20:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dec479b8-6b5f-58e5-8284-5d0bf7123781 with identifier: 10211430
2026-03-29 20:20:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dec479b8-6b5f-58e5-8284-5d0bf7123781 with identifier: 10211430 to the API
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1430/10211430/interior_front_seats-1774692525313.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dec479b8-6b5f-58e5-8284-5d0bf7123781',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP51 SEP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10211430',
'listing': 'auction',
'location': 'Essex Rochford',
'make': 'Peugeot',
'model': '108',
'odometer': 27622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1157545,
'Height': 2027,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_driver-1774692212060.jpg',
'Width': 2703},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505943,
'Height': 2240,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_front_passenger-1774692234573.jpg',
'Width': 2986},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 882105,
'Height': 1721,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1430/10211430/exterior_rear_passenger-1774692222328.jpg',
'Width': 2295},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4449466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1430/10211430/interior_front_seats-1774692525313.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2615664,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1430/10211430/interior_rear_seats-1774692698848.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3225491,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1430/10211430/interior_dashboard-1774692577457.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3494398,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1430/10211430/interior_boot-1774692575716.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 946064,
'Height': 2555,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1430/10211430/docs_service_history-1774693355324.jpg?ixlib=js-3.8.0&auto=format&s=a46201a8dd7f22bc7c3d0e795d1e13ec',
'Width': 3747},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec479b8-6b5f-58e5-8284-5d0bf7123781/dec479b8-6b5f-58e5-8284-5d0bf7123781_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1306846,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1430/10211430/wheels_front_driver-1774692265392.jpg',
'Width': 3385}],
'price': 7746,
'price_includes_vat': False,
'registration_date': '2018-09-22',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 108 Collection S-A',
'transmission': 'automatic',
'trim': 'Collection S-A',
'vin': 'VF3PSCFBDJR190987',
'year': 2018}
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710211430%27 HTTP/1.1" 200 None
2026-03-29 20:20:28 [motorway.uk] INFO: Saving data for 10211430: {'created_time': 1774815628.2248, 'last_price_update_time': 1774815628.224811, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10211430') HTTP/1.1" 204 0
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1360/18301360/18301360-interior_front_seats-default-1774691049553.jpg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_passenger-default-1774689447722.jpg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_driver-1774623415013.jpg> (referer: None)
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf01a90>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1360%252F18301360%252F18301360-interior_front_seats-default-1774691049553.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1360/18301360/18301360-interior_front_seats-default-1774691049553.jpg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19235402.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec39c50>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1360%252F18301360%252F18301360-exterior_rear_passenger-default-1774689447722.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_passenger-default-1774689447722.jpg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7fcae78-88b9-5df8-83c1-03e4f382a227
2026-03-29 20:20:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7fcae78-88b9-5df8-83c1-03e4f382a227, skipping ID generation
2026-03-29 20:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7fcae78-88b9-5df8-83c1-03e4f382a227 with scrape type 1
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7fcae78-88b9-5df8-83c1-03e4f382a227 sending to next pipeline
2026-03-29 20:20:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e7fcae78-88b9-5df8-83c1-03e4f382a227, identifier: 18301360
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadab10>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1433%252F14441433%252Fexterior_front_driver-1774623415013.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_driver-1774623415013.jpg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d
2026-03-29 20:20:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d, skipping ID generation
2026-03-29 20:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d with scrape type 1
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d sending to next pipeline
2026-03-29 20:20:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d, identifier: 14441433
2026-03-29 20:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e7fcae78-88b9-5df8-83c1-03e4f382a227 with identifier: 18301360
2026-03-29 20:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e7fcae78-88b9-5df8-83c1-03e4f382a227 with identifier: 18301360
2026-03-29 20:20:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e7fcae78-88b9-5df8-83c1-03e4f382a227 with identifier: 18301360 to the API
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_passenger-default-1774689447722.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e7fcae78-88b9-5df8-83c1-03e4f382a227',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YE67 XHX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18301360',
'listing': 'auction',
'location': 'Hertfordshire Baldock',
'make': 'Jaguar',
'model': 'F-TYPE',
'odometer': 50792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2233679,
'Height': 2864,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_driver-default-1774689446657.jpg',
'Width': 3818},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2209198,
'Height': 2863,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_driver-default-1774689448079.jpg',
'Width': 3817},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2031617,
'Height': 2830,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_front_passenger-default-1774689455011.jpg',
'Width': 3773},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1951060,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-exterior_rear_passenger-default-1774689447722.jpg',
'Width': 3594},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2343390,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1360/18301360/18301360-interior_front_seats-default-1774691049553.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1651764,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-interior_dashboard-default-1774689497516.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959051,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1360/18301360/18301360-instrument_cluster-default-1774689636055.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2516350,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1360/18301360/18301360-interior_boot-default-1774689483862.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2715979,
'Height': 2905,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689570927.jpg?ixlib=js-3.8.0&auto=format&s=5ccbee4b043a5985b726068e5a806e65',
'Width': 2101},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fcae78-88b9-5df8-83c1-03e4f382a227/e7fcae78-88b9-5df8-83c1-03e4f382a227_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1790189,
'Height': 2684,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1360/18301360/18301360-docs_service_history-default-1774689582837.jpg?ixlib=js-3.8.0&auto=format&s=005b91d0899a88cd1091d7b7f09dab68',
'Width': 1950}],
'price': 20447,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-TYPE I4 Auto',
'transmission': 'automatic',
'trim': 'I4 Auto',
'vin': 'SAJDB5AX2JCK54668',
'year': 2017}
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718301360%27 HTTP/1.1" 200 None
2026-03-29 20:20:29 [motorway.uk] INFO: Saving data for 18301360: {'created_time': 1774815629.232279, 'last_price_update_time': 1774815629.232288, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18301360') HTTP/1.1" 204 0
2026-03-29 20:20:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d with identifier: 14441433
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Bronze HTTP/1.1" 200 None
2026-03-29 20:20:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:20:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d with identifier: 14441433
2026-03-29 20:20:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 95f97cc4-1acd-516e-bdb7-0d0ec8b8372d with identifier: 14441433 to the API
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_driver-1774623415013.jpg>
{'auction_title': '',
'category': None,
'color': 'Bronze',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '95f97cc4-1acd-516e-bdb7-0d0ec8b8372d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DE17 NJX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14441433',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Peugeot',
'model': '3008',
'odometer': 36000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677315,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_driver-1774623415013.jpg',
'Width': 3514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1174418,
'Height': 2394,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_front_passenger-1774623390287.jpg',
'Width': 3192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1442227,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1433/14441433/exterior_rear_passenger-1774623394057.jpg',
'Width': 3266},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4047756,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1433/14441433/interior_front_seats-1774623763932.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3817439,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1433/14441433/interior_rear_seats-1774623973811.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1957353,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1433/14441433/interior_dashboard-1774623895007.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484953,
'Height': 1654,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1433/14441433/instrument_cluster-1774628901305.jpg',
'Width': 2205},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3805880,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1433/14441433/interior_boot-1774623805879.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f97cc4-1acd-516e-bdb7-0d0ec8b8372d/95f97cc4-1acd-516e-bdb7-0d0ec8b8372d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157976,
'Height': 921,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1433/14441433/docs_service_history-1774628993549.jpg?ixlib=js-3.8.0&auto=format&s=6b94eb7dd9f7031d9745dc63a5710365',
'Width': 1228}],
'price': 9600,
'price_includes_vat': False,
'registration_date': '2017-08-25',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 Allure S/S Auto',
'transmission': 'automatic',
'trim': 'Allure S/S Auto',
'vin': 'VF3MRHNYWHS223179',
'year': 2017}
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714441433%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [motorway.uk] INFO: Saving data for 14441433: {'created_time': 1774815630.114438, 'last_price_update_time': 1774815630.11445, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14441433') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87299750-2cd6-5d0c-9d6e-80608111d150 with identifier: 19235402
2026-03-29 20:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87299750-2cd6-5d0c-9d6e-80608111d150 with scrape type 1
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_front_driver-1774294064603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_driver-1774294064603.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_rear_driver-1774294072103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_driver-1774294072103.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_front_passenger-1774294066951.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_passenger-1774294066951.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_rear_passenger-1774294068993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_passenger-1774294068993.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5402%252F19235402%252Finterior_front_seats-1774293391266.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5402/19235402/interior_front_seats-1774293391266.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5402%252F19235402%252Finterior_dashboard-1774691782161.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5402/19235402/interior_dashboard-1774691782161.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Finstrument_cluster-1774293495261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/instrument_cluster-1774293495261.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5402%252F19235402%252Finterior_boot-1774293281113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5402/19235402/interior_boot-1774293281113.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5402%252F19235402%252Fdocs_service_history-1774293993826.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a2b8f3e21f8b4989d5260e364f968ae%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293993826.jpg?ixlib=js-3.8.0&auto=format&s=6a2b8f3e21f8b4989d5260e364f968ae not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5402%252F19235402%252Fdocs_service_history-1774293995243.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49e891e476133501c4085b96e637bbcc%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293995243.jpg?ixlib=js-3.8.0&auto=format&s=49e891e476133501c4085b96e637bbcc not downloaded yet
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_driver-1774294064603.jpg> (referer: None)
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5402/19235402/interior_dashboard-1774691782161.jpg> (referer: None)
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecf0d0>
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_front_driver-1774294064603.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_driver-1774294064603.jpg saved to cache
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_driver-1774294072103.jpg> (referer: None)
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec749d0>
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5402%252F19235402%252Finterior_dashboard-1774691782161.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5402/19235402/interior_dashboard-1774691782161.jpg saved to cache
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20341046.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293995243.jpg?ixlib=js-3.8.0&auto=format&s=49e891e476133501c4085b96e637bbcc> (referer: None)
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca71d10>
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_rear_driver-1774294072103.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_driver-1774294072103.jpg saved to cache
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_passenger-1774294066951.jpg> (referer: None)
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_passenger-1774294068993.jpg> (referer: None)
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5402/19235402/interior_front_seats-1774293391266.jpg> (referer: None)
2026-03-29 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293993826.jpg?ixlib=js-3.8.0&auto=format&s=6a2b8f3e21f8b4989d5260e364f968ae> (referer: None)
2026-03-29 20:20:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7c2a248-15aa-5ef3-8728-75fb41448d7d with identifier: 20341046
2026-03-29 20:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7c2a248-15aa-5ef3-8728-75fb41448d7d with scrape type 1
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_front_driver-1774449204761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_driver-1774449204761.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_rear_driver-1774449219116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_driver-1774449219116.jpg not downloaded yet
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_front_passenger-1774449247533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_passenger-1774449247533.jpg not downloaded yet
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf7410>
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5402%252F19235402%252Fdocs_service_history-1774293995243.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49e891e476133501c4085b96e637bbcc') HTTP/1.1" 204 0
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293995243.jpg?ixlib=js-3.8.0&auto=format&s=49e891e476133501c4085b96e637bbcc saved to cache
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_rear_passenger-1774449237636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_passenger-1774449237636.jpg not downloaded yet
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1046%252F20341046%252Finterior_front_seats-1774449500858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1046/20341046/interior_front_seats-1774449500858.jpg not downloaded yet
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15e050>
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_front_passenger-1774294066951.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_passenger-1774294066951.jpg saved to cache
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafdb10>
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5402%252F19235402%252Fexterior_rear_passenger-1774294068993.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_passenger-1774294068993.jpg saved to cache
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebe8a90>
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5402%252F19235402%252Finterior_front_seats-1774293391266.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5402/19235402/interior_front_seats-1774293391266.jpg saved to cache
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d159310>
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5402%252F19235402%252Fdocs_service_history-1774293993826.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a2b8f3e21f8b4989d5260e364f968ae') HTTP/1.1" 204 0
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293993826.jpg?ixlib=js-3.8.0&auto=format&s=6a2b8f3e21f8b4989d5260e364f968ae saved to cache
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1046%252F20341046%252Finterior_rear_seats-1774449545039.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1046/20341046/interior_rear_seats-1774449545039.jpg not downloaded yet
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1046%252F20341046%252Finterior_dashboard-1774451707778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1046/20341046/interior_dashboard-1774451707778.jpg not downloaded yet
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Finstrument_cluster-1774449604134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/instrument_cluster-1774449604134.jpg not downloaded yet
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1046%252F20341046%252Finterior_boot-1774449614871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1046/20341046/interior_boot-1774449614871.jpg not downloaded yet
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1046%252F20341046%252Fdocs_service_history-1774631613668.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f29f66fc1e87115da1dcd3e227cbbd5%27 HTTP/1.1" 200 None
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1046/20341046/docs_service_history-1774631613668.jpg?ixlib=js-3.8.0&auto=format&s=8f29f66fc1e87115da1dcd3e227cbbd5 not downloaded yet
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 87299750-2cd6-5d0c-9d6e-80608111d150 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5402/19235402/interior_boot-1774293281113.jpg> (referer: None)
2026-03-29 20:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_driver-1774449204761.jpg> (referer: None)
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d743f10>
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5402%252F19235402%252Finterior_boot-1774293281113.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5402/19235402/interior_boot-1774293281113.jpg saved to cache
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87299750-2cd6-5d0c-9d6e-80608111d150
2026-03-29 20:20:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87299750-2cd6-5d0c-9d6e-80608111d150, skipping ID generation
2026-03-29 20:20:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87299750-2cd6-5d0c-9d6e-80608111d150 with scrape type 1
2026-03-29 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87299750-2cd6-5d0c-9d6e-80608111d150 sending to next pipeline
2026-03-29 20:20:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 87299750-2cd6-5d0c-9d6e-80608111d150, identifier: 19235402
2026-03-29 20:20:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 87299750-2cd6-5d0c-9d6e-80608111d150 with identifier: 19235402
2026-03-29 20:20:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 87299750-2cd6-5d0c-9d6e-80608111d150 with identifier: 19235402
2026-03-29 20:20:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 87299750-2cd6-5d0c-9d6e-80608111d150 with identifier: 19235402 to the API
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5402/19235402/interior_boot-1774293281113.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '87299750-2cd6-5d0c-9d6e-80608111d150',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HA18 HJH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19235402',
'listing': 'auction',
'location': 'Staffordshire Lichfield',
'make': 'Volkswagen',
'model': 'Transporter',
'odometer': 79000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 831020,
'Height': 2121,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_driver-1774294064603.jpg',
'Width': 2828},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523097,
'Height': 1765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_driver-1774294072103.jpg',
'Width': 2353},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 736437,
'Height': 1991,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_front_passenger-1774294066951.jpg',
'Width': 2655},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 978175,
'Height': 2302,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5402/19235402/exterior_rear_passenger-1774294068993.jpg',
'Width': 3069},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2511752,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5402/19235402/interior_front_seats-1774293391266.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2782683,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5402/19235402/interior_dashboard-1774691782161.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3490426,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5402/19235402/interior_boot-1774293281113.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528287,
'Height': 3290,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293993826.jpg?ixlib=js-3.8.0&auto=format&s=6a2b8f3e21f8b4989d5260e364f968ae',
'Width': 2202},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87299750-2cd6-5d0c-9d6e-80608111d150/87299750-2cd6-5d0c-9d6e-80608111d150_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343255,
'Height': 3129,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5402/19235402/docs_service_history-1774293995243.jpg?ixlib=js-3.8.0&auto=format&s=49e891e476133501c4085b96e637bbcc',
'Width': 2135}],
'price': 26395,
'price_includes_vat': False,
'registration_date': '2020-07-07',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Transporter T28 Startline TDI',
'transmission': 'manual',
'trim': 'T28 Startline TDI',
'vin': 'WV1ZZZ7HZLX010184',
'year': 2020}
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719235402%27 HTTP/1.1" 200 None
2026-03-29 20:20:32 [motorway.uk] INFO: Saving data for 19235402: {'created_time': 1774815632.885964, 'last_price_update_time': 1774815632.885978, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19235402') HTTP/1.1" 204 0
2026-03-29 20:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d741290>
2026-03-29 20:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_front_driver-1774449204761.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_driver-1774449204761.jpg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1046/20341046/docs_service_history-1774631613668.jpg?ixlib=js-3.8.0&auto=format&s=8f29f66fc1e87115da1dcd3e227cbbd5> (referer: None)
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_passenger-1774449247533.jpg> (referer: None)
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_driver-1774449219116.jpg> (referer: None)
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_passenger-1774449237636.jpg> (referer: None)
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1046/20341046/interior_dashboard-1774451707778.jpg> (referer: None)
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1046/20341046/interior_rear_seats-1774449545039.jpg> (referer: None)
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1046/20341046/interior_front_seats-1774449500858.jpg> (referer: None)
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e072c50>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1046%252F20341046%252Fdocs_service_history-1774631613668.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f29f66fc1e87115da1dcd3e227cbbd5') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1046/20341046/docs_service_history-1774631613668.jpg?ixlib=js-3.8.0&auto=format&s=8f29f66fc1e87115da1dcd3e227cbbd5 saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2af510>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_front_passenger-1774449247533.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_passenger-1774449247533.jpg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488258.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d138c90>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_rear_driver-1774449219116.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_driver-1774449219116.jpg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d139790>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Fexterior_rear_passenger-1774449237636.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_passenger-1774449237636.jpg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc142d94d0>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1046%252F20341046%252Finterior_dashboard-1774451707778.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1046/20341046/interior_dashboard-1774451707778.jpg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5728d0>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1046%252F20341046%252Finterior_rear_seats-1774449545039.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1046/20341046/interior_rear_seats-1774449545039.jpg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2ad0d0>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1046%252F20341046%252Finterior_front_seats-1774449500858.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1046/20341046/interior_front_seats-1774449500858.jpg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5eefec-706e-5f69-90f9-306ea46ac637 with identifier: 20488258
2026-03-29 20:20:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5eefec-706e-5f69-90f9-306ea46ac637 with scrape type 1
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Fexterior_front_driver-1774716104375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/exterior_front_driver-1774716104375.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Fexterior_rear_driver-1774716114518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/exterior_rear_driver-1774716114518.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8258%252F20488258%252Fexterior_front_passenger-1774713695586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_front_passenger-1774713695586.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8258%252F20488258%252Fexterior_rear_passenger-1774713678019.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_rear_passenger-1774713678019.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Finterior_front_seats-1774716128185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/interior_front_seats-1774716128185.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Finterior_rear_seats-1774716205183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/interior_rear_seats-1774716205183.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Finterior_dashboard-1774716211144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/interior_dashboard-1774716211144.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8258%252F20488258%252Finstrument_cluster-1774714543949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8258/20488258/instrument_cluster-1774714543949.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8258%252F20488258%252Finterior_boot-1774714546483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8258/20488258/interior_boot-1774714546483.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8258%252F20488258%252Fdocs_service_history-1774716251474.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D68bf5fb50c0e4c226b86a5c2f7f0b0e3%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8258/20488258/docs_service_history-1774716251474.jpg?ixlib=js-3.8.0&auto=format&s=68bf5fb50c0e4c226b86a5c2f7f0b0e3 not downloaded yet
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1046/20341046/instrument_cluster-1774449604134.jpg> (referer: None)
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8258/20488258/exterior_front_driver-1774716104375.jpg> (referer: None)
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8258/20488258/exterior_rear_driver-1774716114518.jpg> (referer: None)
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1046/20341046/interior_boot-1774449614871.jpg> (referer: None)
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8258/20488258/docs_service_history-1774716251474.jpg?ixlib=js-3.8.0&auto=format&s=68bf5fb50c0e4c226b86a5c2f7f0b0e3> (referer: None)
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa5790>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1046%252F20341046%252Finstrument_cluster-1774449604134.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1046/20341046/instrument_cluster-1774449604134.jpg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa4650>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Fexterior_front_driver-1774716104375.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/exterior_front_driver-1774716104375.jpg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced7c90>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8258%252F20488258%252Fexterior_rear_driver-1774716114518.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8258/20488258/exterior_rear_driver-1774716114518.jpg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c256190>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1046%252F20341046%252Finterior_boot-1774449614871.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1046/20341046/interior_boot-1774449614871.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7c2a248-15aa-5ef3-8728-75fb41448d7d
2026-03-29 20:20:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7c2a248-15aa-5ef3-8728-75fb41448d7d, skipping ID generation
2026-03-29 20:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7c2a248-15aa-5ef3-8728-75fb41448d7d with scrape type 1
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7c2a248-15aa-5ef3-8728-75fb41448d7d sending to next pipeline
2026-03-29 20:20:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d7c2a248-15aa-5ef3-8728-75fb41448d7d, identifier: 20341046
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce4be10>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8258%252F20488258%252Fdocs_service_history-1774716251474.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D68bf5fb50c0e4c226b86a5c2f7f0b0e3') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8258/20488258/docs_service_history-1774716251474.jpg?ixlib=js-3.8.0&auto=format&s=68bf5fb50c0e4c226b86a5c2f7f0b0e3 saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d7c2a248-15aa-5ef3-8728-75fb41448d7d with identifier: 20341046
2026-03-29 20:20:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d7c2a248-15aa-5ef3-8728-75fb41448d7d with identifier: 20341046
2026-03-29 20:20:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d7c2a248-15aa-5ef3-8728-75fb41448d7d with identifier: 20341046 to the API
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1046/20341046/interior_boot-1774449614871.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd7c2a248-15aa-5ef3-8728-75fb41448d7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R55 CSC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20341046',
'listing': 'auction',
'location': 'Staffordshire Newcastle',
'make': 'Ford',
'model': 'Focus',
'odometer': 17700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007140,
'Height': 2525,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_driver-1774449204761.jpg',
'Width': 3366},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1561097,
'Height': 2407,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_driver-1774449219116.jpg',
'Width': 3209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1201490,
'Height': 2235,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_front_passenger-1774449247533.jpg',
'Width': 2980},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1545217,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1046/20341046/exterior_rear_passenger-1774449237636.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4038827,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1046/20341046/interior_front_seats-1774449500858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2765559,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1046/20341046/interior_rear_seats-1774449545039.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439871,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1046/20341046/interior_dashboard-1774451707778.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2395227,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1046/20341046/instrument_cluster-1774449604134.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4187114,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1046/20341046/interior_boot-1774449614871.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c2a248-15aa-5ef3-8728-75fb41448d7d/d7c2a248-15aa-5ef3-8728-75fb41448d7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1154295,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1046/20341046/docs_service_history-1774631613668.jpg?ixlib=js-3.8.0&auto=format&s=8f29f66fc1e87115da1dcd3e227cbbd5',
'Width': 3024}],
'price': 25327,
'price_includes_vat': False,
'registration_date': '2016-06-20',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus RS',
'transmission': 'manual',
'trim': 'RS',
'vin': 'WF05XXGCC5GR64254',
'year': 2016}
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720341046%27 HTTP/1.1" 200 None
2026-03-29 20:20:35 [motorway.uk] INFO: Saving data for 20341046: {'created_time': 1774815635.609731, 'last_price_update_time': 1774815635.609741, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20341046') HTTP/1.1" 204 0
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_rear_passenger-1774713678019.jpg> (referer: None)
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_front_passenger-1774713695586.jpg> (referer: None)
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8258/20488258/interior_boot-1774714546483.jpg> (referer: None)
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 5d5eefec-706e-5f69-90f9-306ea46ac637 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 5d5eefec-706e-5f69-90f9-306ea46ac637 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5d5eefec-706e-5f69-90f9-306ea46ac637 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22ef50>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8258%252F20488258%252Fexterior_rear_passenger-1774713678019.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_rear_passenger-1774713678019.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7b850>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8258%252F20488258%252Fexterior_front_passenger-1774713695586.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_front_passenger-1774713695586.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:20:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c406f90>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8258%252F20488258%252Finterior_boot-1774714546483.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8258/20488258/interior_boot-1774714546483.jpg saved to cache
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8258/20488258/instrument_cluster-1774714543949.jpg> (referer: None)
2026-03-29 20:20:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:20:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58c210>
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8258%252F20488258%252Finstrument_cluster-1774714543949.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8258/20488258/instrument_cluster-1774714543949.jpg saved to cache
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d5eefec-706e-5f69-90f9-306ea46ac637
2026-03-29 20:20:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d5eefec-706e-5f69-90f9-306ea46ac637, skipping ID generation
2026-03-29 20:20:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5eefec-706e-5f69-90f9-306ea46ac637 with scrape type 1
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d5eefec-706e-5f69-90f9-306ea46ac637 sending to next pipeline
2026-03-29 20:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5d5eefec-706e-5f69-90f9-306ea46ac637, identifier: 20488258
2026-03-29 20:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5d5eefec-706e-5f69-90f9-306ea46ac637 with identifier: 20488258
2026-03-29 20:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5d5eefec-706e-5f69-90f9-306ea46ac637 with identifier: 20488258
2026-03-29 20:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5d5eefec-706e-5f69-90f9-306ea46ac637 with identifier: 20488258 to the API
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8258/20488258/instrument_cluster-1774714543949.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '5d5eefec-706e-5f69-90f9-306ea46ac637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP22 OJY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488258',
'listing': 'auction',
'location': 'Swansea Swansea',
'make': 'Volvo',
'model': 'XC40',
'odometer': 32636,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2088568,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8258/20488258/exterior_front_driver-1774716104375.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2205434,
'Height': 2677,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8258/20488258/exterior_rear_driver-1774716114518.jpg',
'Width': 3569},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1789071,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_front_passenger-1774713695586.jpg',
'Width': 3703},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387077,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8258/20488258/exterior_rear_passenger-1774713678019.jpg',
'Width': 3570},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2127987,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8258/20488258/instrument_cluster-1774714543949.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3614225,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8258/20488258/interior_boot-1774714546483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5eefec-706e-5f69-90f9-306ea46ac637/5d5eefec-706e-5f69-90f9-306ea46ac637_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866944,
'Height': 3913,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8258/20488258/docs_service_history-1774716251474.jpg?ixlib=js-3.8.0&auto=format&s=68bf5fb50c0e4c226b86a5c2f7f0b0e3',
'Width': 5217}],
'price': 21357,
'price_includes_vat': False,
'registration_date': '2022-05-18',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC40 Rdesign PRO T5 Recharge A',
'transmission': 'automatic',
'trim': 'Rdesign PRO T5 Recharge A',
'vin': 'YV1XZBBTFN2771218',
'year': 2022}
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488258%27 HTTP/1.1" 200 None
2026-03-29 20:20:36 [motorway.uk] INFO: Saving data for 20488258: {'created_time': 1774815636.809538, 'last_price_update_time': 1774815636.809552, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488258') HTTP/1.1" 204 0
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488394.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db5ceddd-11d3-5952-9af3-24fbd30a9ac9 with identifier: 20488394
2026-03-29 20:20:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9 with scrape type 1
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_front_driver-1774710982927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_driver-1774710982927.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_rear_driver-1774710930097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_driver-1774710930097.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_front_passenger-1774710964091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_passenger-1774710964091.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_rear_passenger-1774710939903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_passenger-1774710939903.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Finterior_front_seats-1774711719156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/interior_front_seats-1774711719156.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Finterior_rear_seats-1774711660466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/interior_rear_seats-1774711660466.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8394%252F20488394%252Finterior_dashboard-1774713072814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8394/20488394/interior_dashboard-1774713072814.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Finterior_boot-1774711676366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/interior_boot-1774711676366.jpg not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8394%252F20488394%252Fdocs_service_history-1774712052828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3fde3ab6a935c2d32e7551a193c22f5%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8394/20488394/docs_service_history-1774712052828.jpg?ixlib=js-3.8.0&auto=format&s=b3fde3ab6a935c2d32e7551a193c22f5 not downloaded yet
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Fdamage_dents-1774711101834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/damage_dents-1774711101834.jpg not downloaded yet
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_driver-1774710982927.jpg> (referer: None)
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_passenger-1774710964091.jpg> (referer: None)
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8394/20488394/docs_service_history-1774712052828.jpg?ixlib=js-3.8.0&auto=format&s=b3fde3ab6a935c2d32e7551a193c22f5> (referer: None)
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_passenger-1774710939903.jpg> (referer: None)
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_driver-1774710930097.jpg> (referer: None)
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00db50>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_front_driver-1774710982927.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_driver-1774710982927.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8394/20488394/interior_dashboard-1774713072814.jpg> (referer: None)
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2c650>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_front_passenger-1774710964091.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_passenger-1774710964091.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e942e10>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8394%252F20488394%252Fdocs_service_history-1774712052828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3fde3ab6a935c2d32e7551a193c22f5') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8394/20488394/docs_service_history-1774712052828.jpg?ixlib=js-3.8.0&auto=format&s=b3fde3ab6a935c2d32e7551a193c22f5 saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e942850>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_rear_passenger-1774710939903.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_passenger-1774710939903.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d556bd0>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8394%252F20488394%252Fexterior_rear_driver-1774710930097.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_driver-1774710930097.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8394/20488394/interior_front_seats-1774711719156.jpg> (referer: None)
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24ef50>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8394%252F20488394%252Finterior_dashboard-1774713072814.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8394/20488394/interior_dashboard-1774713072814.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8394/20488394/interior_rear_seats-1774711660466.jpg> (referer: None)
2026-03-29 20:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8394/20488394/interior_boot-1774711676366.jpg> (referer: None)
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed81e10>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Finterior_front_seats-1774711719156.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/interior_front_seats-1774711719156.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1498d0>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Finterior_rear_seats-1774711660466.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/interior_rear_seats-1774711660466.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d786d10>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Finterior_boot-1774711676366.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/interior_boot-1774711676366.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8394/20488394/damage_dents-1774711101834.jpg> (referer: None)
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d14b150>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8394%252F20488394%252Fdamage_dents-1774711101834.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8394/20488394/damage_dents-1774711101834.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9
2026-03-29 20:20:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db5ceddd-11d3-5952-9af3-24fbd30a9ac9, skipping ID generation
2026-03-29 20:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9 with scrape type 1
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db5ceddd-11d3-5952-9af3-24fbd30a9ac9 sending to next pipeline
2026-03-29 20:20:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: db5ceddd-11d3-5952-9af3-24fbd30a9ac9, identifier: 20488394
2026-03-29 20:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: db5ceddd-11d3-5952-9af3-24fbd30a9ac9 with identifier: 20488394
2026-03-29 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: db5ceddd-11d3-5952-9af3-24fbd30a9ac9 with identifier: 20488394
2026-03-29 20:20:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: db5ceddd-11d3-5952-9af3-24fbd30a9ac9 with identifier: 20488394 to the API
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8394/20488394/damage_dents-1774711101834.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'db5ceddd-11d3-5952-9af3-24fbd30a9ac9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NJ22 TZG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488394',
'listing': 'auction',
'location': 'None None',
'make': 'Tesla',
'model': 'Model 3',
'odometer': 16971,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2126453,
'Height': 2780,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_driver-1774710982927.jpg',
'Width': 3707},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2646646,
'Height': 2978,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_driver-1774710930097.jpg',
'Width': 3971},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1555512,
'Height': 2610,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_front_passenger-1774710964091.jpg',
'Width': 3480},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2149429,
'Height': 2973,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8394/20488394/exterior_rear_passenger-1774710939903.jpg',
'Width': 3964},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2815254,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8394/20488394/interior_front_seats-1774711719156.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2756938,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8394/20488394/interior_rear_seats-1774711660466.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1815307,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8394/20488394/interior_dashboard-1774713072814.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3319878,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8394/20488394/interior_boot-1774711676366.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245265,
'Height': 2868,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8394/20488394/docs_service_history-1774712052828.jpg?ixlib=js-3.8.0&auto=format&s=b3fde3ab6a935c2d32e7551a193c22f5',
'Width': 1320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5ceddd-11d3-5952-9af3-24fbd30a9ac9/db5ceddd-11d3-5952-9af3-24fbd30a9ac9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3207528,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8394/20488394/damage_dents-1774711101834.jpg',
'Width': 4032}],
'price': 15589,
'price_includes_vat': False,
'registration_date': '2022-03-11',
'seats_number': None,
'seller_name': None,
'title': 'Tesla Model 3 Standard Range +',
'transmission': 'automatic',
'trim': 'Standard Range +',
'vin': 'LRW3F7FS2NC504467',
'year': 2022}
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488394%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [motorway.uk] INFO: Saving data for 20488394: {'created_time': 1774815639.454166, 'last_price_update_time': 1774815639.454176, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488394') HTTP/1.1" 204 0
2026-03-29 20:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20023878.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a832f15f-30d0-56c1-8933-f8233be3b165 with identifier: 20023878
2026-03-29 20:20:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a832f15f-30d0-56c1-8933-f8233be3b165 with scrape type 1
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a832f15f-30d0-56c1-8933-f8233be3b165
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3878%252F20023878%252Fexterior_front_driver-1772296737696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_front_driver-1772296737696.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3878%252F20023878%252Fexterior_rear_driver-1772296763854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_rear_driver-1772296763854.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3878%252F20023878%252Fexterior_front_passenger-1772296972681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_front_passenger-1772296972681.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3878%252F20023878%252Fexterior_rear_passenger-1772296785246.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_rear_passenger-1772296785246.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3878%252F20023878%252Finterior_front_seats-1772211782823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3878/20023878/interior_front_seats-1772211782823.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3878%252F20023878%252Finterior_rear_seats-1772211563466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3878/20023878/interior_rear_seats-1772211563466.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3878%252F20023878%252Finterior_dashboard-1772297094996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3878/20023878/interior_dashboard-1772297094996.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3878%252F20023878%252Finterior_boot-1772211574750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3878/20023878/interior_boot-1772211574750.jpg already downloaded
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3878%252F20023878%252Fdocs_service_history-1772545960674.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D09d3d4777c6a6fe93b3c12269011ad3b%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3878/20023878/docs_service_history-1772545960674.jpg?ixlib=js-3.8.0&auto=format&s=09d3d4777c6a6fe93b3c12269011ad3b already downloaded
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3878%252F20023878%252Fdocs_service_history-1772545982985.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D77205f5691b0edf68e5a0cc29f93c000%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3878/20023878/docs_service_history-1772545982985.jpg?ixlib=js-3.8.0&auto=format&s=77205f5691b0edf68e5a0cc29f93c000 already downloaded
2026-03-29 20:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a832f15f-30d0-56c1-8933-f8233be3b165, identifier: 20023878
2026-03-29 20:20:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a832f15f-30d0-56c1-8933-f8233be3b165 with identifier: 20023878
2026-03-29 20:20:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a832f15f-30d0-56c1-8933-f8233be3b165 with identifier: 20023878
2026-03-29 20:20:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a832f15f-30d0-56c1-8933-f8233be3b165 with identifier: 20023878 to the API
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20023878.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a832f15f-30d0-56c1-8933-f8233be3b165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PJ16 PZT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20023878',
'listing': 'auction',
'location': 'South Yorkshire Doncaster',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 44500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_front_driver-1772296737696.jpg',
'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_rear_driver-1772296763854.jpg',
'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_front_passenger-1772296972681.jpg',
'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_rear_passenger-1772296785246.jpg',
'https://motorway-photos.imgix.net/3878/20023878/interior_front_seats-1772211782823.jpg',
'https://motorway-photos.imgix.net/3878/20023878/interior_rear_seats-1772211563466.jpg',
'https://motorway-photos-redacted.imgix.net/3878/20023878/interior_dashboard-1772297094996.jpg',
'https://motorway-photos.imgix.net/3878/20023878/interior_boot-1772211574750.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/3878/20023878/docs_service_history-1772545960674.jpg?ixlib=js-3.8.0&auto=format&s=09d3d4777c6a6fe93b3c12269011ad3b',
'https://motorway-service-history-photos.imgix.net/redacted/3878/20023878/docs_service_history-1772545982985.jpg?ixlib=js-3.8.0&auto=format&s=77205f5691b0edf68e5a0cc29f93c000'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1108886,
'Height': 2144,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_front_driver-1772296737696.jpg',
'Width': 2859},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1140479,
'Height': 2119,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_rear_driver-1772296763854.jpg',
'Width': 2825},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1243694,
'Height': 2219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_front_passenger-1772296972681.jpg',
'Width': 2959},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 941076,
'Height': 2084,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3878/20023878/exterior_rear_passenger-1772296785246.jpg',
'Width': 2779},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6406611,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/3878/20023878/interior_front_seats-1772211782823.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7234076,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/3878/20023878/interior_rear_seats-1772211563466.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1299593,
'Height': 4000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3878/20023878/interior_dashboard-1772297094996.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d175eb-e067-50af-bed0-350db02f8042/79d175eb-e067-50af-bed0-350db02f8042_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5965742,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/3878/20023878/interior_boot-1772211574750.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2da182-48ea-5f43-ac55-2012989058d1/fc2da182-48ea-5f43-ac55-2012989058d1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5224920,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3878/20023878/docs_service_history-1772545960674.jpg?ixlib=js-3.8.0&auto=format&s=09d3d4777c6a6fe93b3c12269011ad3b',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2da182-48ea-5f43-ac55-2012989058d1/fc2da182-48ea-5f43-ac55-2012989058d1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700655,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3878/20023878/docs_service_history-1772545982985.jpg?ixlib=js-3.8.0&auto=format&s=77205f5691b0edf68e5a0cc29f93c000',
'Width': 3000}],
'price': 8292,
'price_includes_vat': False,
'registration_date': '2016-04-28',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Beetle Design TDI Bmotion Tech',
'transmission': 'manual',
'trim': 'Design TDI Bmotion Tech',
'vin': 'WVWZZZ16ZGM614092',
'year': 2016}
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720023878%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Saving data for 20023878: {'created_time': 1774815640.498806, 'last_price_update_time': 1774815640.498816, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20023878') HTTP/1.1" 204 0
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=468&page=13&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20462264
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20078752
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20484739
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20424839
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 16384485
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 19642157
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18664090
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718664090%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 18664090: 1
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 19912374
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20481823
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 10709908
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710709908%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 10709908: 1
2026-03-29 20:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20486849
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20467542
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 17665821
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 2147652
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20382820
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382820%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 20382820: 1
2026-03-29 20:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20413228
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20369309
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20039478
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18265628
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20220021
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20487110
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18634459
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718634459%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 18634459: 1
2026-03-29 20:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 11969339
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711969339%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 11969339: 1
2026-03-29 20:20:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20487185
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18469041
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20456356
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456356%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 20456356: 1
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18709305
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20490237
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490237%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 20490237: 1
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 19442969
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20171226
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720171226%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 20171226: 1
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18254903
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 9247330
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279247330%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 9247330: 1
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20221098
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720221098%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 20221098: 2
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20269740
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 20454557
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454557%27 HTTP/1.1" 200 None
2026-03-29 20:20:40 [motorway.uk] INFO: Scrape type for 20454557: 1
2026-03-29 20:20:40 [motorway.uk] INFO: Found listing with ID: 18587365
2026-03-29 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10709908.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 with identifier: 10709908
2026-03-29 20:20:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 with scrape type 1
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_front_driver-1774181825980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_driver-1774181825980.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_rear_driver-1774181858563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_driver-1774181858563.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_front_passenger-1774181954117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_passenger-1774181954117.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_rear_passenger-1774181921752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_passenger-1774181921752.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9908%252F10709908%252Finterior_front_seats-1774182780280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9908/10709908/interior_front_seats-1774182780280.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9908%252F10709908%252Finterior_rear_seats-1774182460988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9908/10709908/interior_rear_seats-1774182460988.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Finterior_dashboard-1774182500604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/interior_dashboard-1774182500604.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Finstrument_cluster-1774182544411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/instrument_cluster-1774182544411.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9908%252F10709908%252Finterior_boot-1774182792444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9908/10709908/interior_boot-1774182792444.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9908%252F10709908%252Fdocs_service_history-1774716404046.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da6608edbefcbefe3bbc335f39bd81dad%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9908/10709908/docs_service_history-1774716404046.jpg?ixlib=js-3.8.0&auto=format&s=a6608edbefcbefe3bbc335f39bd81dad not downloaded yet
2026-03-29 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18664090.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdb0f00-716e-5ed2-8037-f2a7bb811019 with identifier: 18664090
2026-03-29 20:20:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019 with scrape type 1
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4090%252F18664090%252F18664090-exterior_front_driver-modified-1774718719166.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_front_driver-modified-1774718719166.jpeg not downloaded yet
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_driver-1774181825980.jpg> (referer: None)
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4090%252F18664090%252F18664090-exterior_rear_driver-modified-1774717612259.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_rear_driver-modified-1774717612259.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Fexterior_front_passenger-1774711129082.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_front_passenger-1774711129082.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Fexterior_rear_passenger-1774711144568.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_rear_passenger-1774711144568.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4090%252F18664090%252Finterior_front_seats-1774711382402.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4090/18664090/interior_front_seats-1774711382402.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4090%252F18664090%252Finterior_rear_seats-1774711261753.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4090/18664090/interior_rear_seats-1774711261753.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Finterior_dashboard-1774711288622.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/interior_dashboard-1774711288622.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Finstrument_cluster-1774711364025.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/instrument_cluster-1774711364025.jpeg not downloaded yet
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1462d0>
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_front_driver-1774181825980.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_driver-1774181825980.jpg saved to cache
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4090%252F18664090%252Finterior_boot-1774711294817.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4090/18664090/interior_boot-1774711294817.jpeg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4090%252F18664090%252Fdocs_service_history-1774712478616.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D706ceca0d9ea5265c9b4570731fad0a1%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4090/18664090/docs_service_history-1774712478616.jpeg?ixlib=js-3.8.0&auto=format&s=706ceca0d9ea5265c9b4570731fad0a1 not downloaded yet
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9908/10709908/docs_service_history-1774716404046.jpg?ixlib=js-3.8.0&auto=format&s=a6608edbefcbefe3bbc335f39bd81dad> (referer: None)
2026-03-29 20:20:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\x9b\x08\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04+\x90\x002v\xe4\x00\x00\x00\x00'
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf5290>
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9908%252F10709908%252Fdocs_service_history-1774716404046.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da6608edbefcbefe3bbc335f39bd81dad') HTTP/1.1" 204 0
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9908/10709908/docs_service_history-1774716404046.jpg?ixlib=js-3.8.0&auto=format&s=a6608edbefcbefe3bbc335f39bd81dad saved to cache
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_front_driver-modified-1774718719166.jpeg> (referer: None)
2026-03-29 20:20:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.415(s), this was the 1st time calling it.
2026-03-29 20:20:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.7209975454167274 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2302d0>
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4090%252F18664090%252F18664090-exterior_front_driver-modified-1774718719166.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_front_driver-modified-1774718719166.jpeg saved to cache
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4090/18664090/docs_service_history-1774712478616.jpeg?ixlib=js-3.8.0&auto=format&s=706ceca0d9ea5265c9b4570731fad0a1> (referer: None)
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20382820.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4090/18664090/interior_boot-1774711294817.jpeg> (referer: None)
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11c3d0>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4090%252F18664090%252Fdocs_service_history-1774712478616.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D706ceca0d9ea5265c9b4570731fad0a1') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4090/18664090/docs_service_history-1774712478616.jpeg?ixlib=js-3.8.0&auto=format&s=706ceca0d9ea5265c9b4570731fad0a1 saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd8ec6f-95fe-5d7f-9845-347a2851a703 with identifier: 20382820
2026-03-29 20:20:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703 with scrape type 1
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_front_driver-1774703868893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_driver-1774703868893.jpg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_rear_driver-1774703209807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_driver-1774703209807.jpg not downloaded yet
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-w\xf3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xdb\x19\x00-ma\x00\x00\x00\x00'
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21f050>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4090%252F18664090%252Finterior_boot-1774711294817.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4090/18664090/interior_boot-1774711294817.jpeg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_front_passenger-1774703237024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_passenger-1774703237024.jpg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_rear_passenger-1774703221800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_passenger-1774703221800.jpg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2820%252F20382820%252Finterior_front_seats-1774703471504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2820/20382820/interior_front_seats-1774703471504.jpg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2820%252F20382820%252F20382820-interior_dashboard-modified-1774704440676.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2820/20382820/20382820-interior_dashboard-modified-1774704440676.jpeg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2820%252F20382820%252Finterior_boot-1774704143900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2820/20382820/interior_boot-1774704143900.jpg not downloaded yet
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4090/18664090/instrument_cluster-1774711364025.jpeg> (referer: None)
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2820%252F20382820%252Fdamage_windscreen-1774703285157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2820/20382820/damage_windscreen-1774703285157.jpg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fwheels_front_driver-1774703311426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_front_driver-1774703311426.jpg not downloaded yet
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fwheels_rear_driver-1774703333340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_rear_driver-1774703333340.jpg not downloaded yet
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4090/18664090/interior_dashboard-1774711288622.jpeg> (referer: None)
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c659390>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Finstrument_cluster-1774711364025.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/instrument_cluster-1774711364025.jpeg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c658850>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Finterior_dashboard-1774711288622.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/interior_dashboard-1774711288622.jpeg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18634459.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4090/18664090/interior_rear_seats-1774711261753.jpeg> (referer: None)
2026-03-29 20:20:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65881d93-46cb-5528-a8d1-f46d766c9a89 with identifier: 18634459
2026-03-29 20:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65881d93-46cb-5528-a8d1-f46d766c9a89 with scrape type 1
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_front_driver-1774630552891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_driver-1774630552891.jpg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_rear_driver-1774630578918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_rear_driver-1774630578918.jpg not downloaded yet
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2820/20382820/20382820-interior_dashboard-modified-1774704440676.jpeg> (referer: None)
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_front_passenger-1774630641474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_passenger-1774630641474.jpg not downloaded yet
2026-03-29 20:20:46 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:46 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:46 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\x9a\x86\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb7\x16\x002\x8f\xf4\x00\x00\x00\x00'
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf01ad0>
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4090%252F18664090%252Finterior_rear_seats-1774711261753.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4090/18664090/interior_rear_seats-1774711261753.jpeg saved to cache
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_rear_passenger-1774630591988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_rear_passenger-1774630591988.jpg not downloaded yet
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11969339.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4459%252F18634459%252Finterior_front_seats-1774631434363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4459/18634459/interior_front_seats-1774631434363.jpg not downloaded yet
2026-03-29 20:20:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d14ad50>
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2820%252F20382820%252F20382820-interior_dashboard-modified-1774704440676.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2820/20382820/20382820-interior_dashboard-modified-1774704440676.jpeg saved to cache
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_rear_driver-1774703333340.jpg> (referer: None)
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4459%252F18634459%252Finterior_rear_seats-1774631438726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4459/18634459/interior_rear_seats-1774631438726.jpg not downloaded yet
2026-03-29 20:20:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40aad7e7-65e0-58a8-b442-438b46772d00 with identifier: 11969339
2026-03-29 20:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40aad7e7-65e0-58a8-b442-438b46772d00 with scrape type 1
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Fexterior_front_driver-1774691306306.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_driver-1774691306306.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Finterior_dashboard-1774631447491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/interior_dashboard-1774631447491.jpg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Fexterior_rear_driver-1774691371462.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_driver-1774691371462.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Finstrument_cluster-1774631627199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/instrument_cluster-1774631627199.jpg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Fexterior_front_passenger-1774691880216.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_passenger-1774691880216.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4459%252F18634459%252Finterior_boot-1774631490350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4459/18634459/interior_boot-1774631490350.jpg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Fexterior_rear_passenger-1774691388410.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_passenger-1774691388410.jpeg not downloaded yet
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6d790>
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fwheels_rear_driver-1774703333340.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_rear_driver-1774703333340.jpg saved to cache
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4459%252F18634459%252Fdocs_service_history-1774634371327.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D128afc6edc8b9bccacd5a6f5be90522e%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4459/18634459/docs_service_history-1774634371327.jpg?ixlib=js-3.8.0&auto=format&s=128afc6edc8b9bccacd5a6f5be90522e not downloaded yet
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_front_driver-1774703311426.jpg> (referer: None)
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9339%252F11969339%252Finterior_front_seats-1774691563752.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9339/11969339/interior_front_seats-1774691563752.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9339%252F11969339%252Finterior_rear_seats-1774692281029.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9339/11969339/interior_rear_seats-1774692281029.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Finterior_dashboard-1774691696796.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/interior_dashboard-1774691696796.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Finstrument_cluster-1774691722448.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/instrument_cluster-1774691722448.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9339%252F11969339%252Finterior_boot-1774691708249.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9339/11969339/interior_boot-1774691708249.jpeg not downloaded yet
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9339%252F11969339%252Fdocs_service_history-1774709578153.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59f792a28c83a860059a59c626b2e92e%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9339/11969339/docs_service_history-1774709578153.jpeg?ixlib=js-3.8.0&auto=format&s=59f792a28c83a860059a59c626b2e92e not downloaded yet
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cae60d0>
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fwheels_front_driver-1774703311426.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_front_driver-1774703311426.jpg saved to cache
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2820/20382820/damage_windscreen-1774703285157.jpg> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_rear_passenger-1774630591988.jpg> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_passenger-1774630641474.jpg> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4459/18634459/interior_rear_seats-1774631438726.jpg> (referer: None)
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b8090>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2820%252F20382820%252Fdamage_windscreen-1774703285157.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2820/20382820/damage_windscreen-1774703285157.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c666250>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_rear_passenger-1774630591988.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_rear_passenger-1774630591988.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3fad0>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_front_passenger-1774630641474.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_passenger-1774630641474.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07e490>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4459%252F18634459%252Finterior_rear_seats-1774631438726.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4459/18634459/interior_rear_seats-1774631438726.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20494032.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9339/11969339/docs_service_history-1774709578153.jpeg?ixlib=js-3.8.0&auto=format&s=59f792a28c83a860059a59c626b2e92e> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_passenger-1774691388410.jpeg> (referer: None)
2026-03-29 20:20:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027c7b50-13fc-5eba-8be4-5f0294aac0fe with identifier: 20494032
2026-03-29 20:20:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe with scrape type 1
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20494032%252Fexterior_front_driver-1774721109850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_front_driver-1774721109850.jpg not downloaded yet
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20494032%252Fexterior_rear_driver-1774721083129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_driver-1774721083129.jpg not downloaded yet
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20494032%252Fexterior_front_passenger-1774721049047.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_front_passenger-1774721049047.jpg not downloaded yet
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea44c10>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9339%252F11969339%252Fdocs_service_history-1774709578153.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59f792a28c83a860059a59c626b2e92e') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9339/11969339/docs_service_history-1774709578153.jpeg?ixlib=js-3.8.0&auto=format&s=59f792a28c83a860059a59c626b2e92e saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22d490>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Fexterior_rear_passenger-1774691388410.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_passenger-1774691388410.jpeg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20494032%252Fexterior_rear_passenger-1774721068066.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_passenger-1774721068066.jpg not downloaded yet
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490237.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20494032%252Finterior_front_seats-1774722351118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20494032/interior_front_seats-1774722351118.jpg not downloaded yet
2026-03-29 20:20:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20494032%252Finterior_rear_seats-1774722541823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20494032/interior_rear_seats-1774722541823.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4032%252F20494032%252Finterior_dashboard-1774775208905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4032/20494032/interior_dashboard-1774775208905.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20494032%252Finstrument_cluster-1774722399152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20494032/instrument_cluster-1774722399152.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20494032%252Finterior_boot-1774722627730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20494032/interior_boot-1774722627730.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4032%252F20494032%252Fdocs_service_history-1774775188815.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04c7aa77c02df6ac8cbc3025833a07a2%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4032/20494032/docs_service_history-1774775188815.jpg?ixlib=js-3.8.0&auto=format&s=04c7aa77c02df6ac8cbc3025833a07a2 not downloaded yet
2026-03-29 20:20:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c29919-9597-58b1-bc0b-23d74e9db710 with identifier: 20490237
2026-03-29 20:20:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c29919-9597-58b1-bc0b-23d74e9db710 with scrape type 1
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_front_driver-1774709574770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_driver-1774709574770.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_rear_driver-1774709588197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_driver-1774709588197.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_front_passenger-1774709614225.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_passenger-1774709614225.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_rear_passenger-1774709600342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_passenger-1774709600342.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0237%252F20490237%252Finterior_front_seats-1774710002005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0237/20490237/interior_front_seats-1774710002005.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0237%252F20490237%252Finterior_rear_seats-1774710012705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0237/20490237/interior_rear_seats-1774710012705.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0237%252F20490237%252Finterior_dashboard-1774777994878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0237/20490237/interior_dashboard-1774777994878.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0237%252F20490237%252Finstrument_cluster-1774778010348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0237/20490237/instrument_cluster-1774778010348.jpg not downloaded yet
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9339/11969339/interior_dashboard-1774691696796.jpeg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_passenger-1774721068066.jpg> (referer: None)
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0237%252F20490237%252Finterior_boot-1774710063081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0237/20490237/interior_boot-1774710063081.jpg not downloaded yet
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0237%252F20490237%252Fdamage_missing_trims-1774777766890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0237/20490237/damage_missing_trims-1774777766890.jpg not downloaded yet
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9339/11969339/instrument_cluster-1774691722448.jpeg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9339/11969339/interior_rear_seats-1774692281029.jpeg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9339/11969339/interior_front_seats-1774691563752.jpeg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9339/11969339/interior_boot-1774691708249.jpeg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4459/18634459/docs_service_history-1774634371327.jpg?ixlib=js-3.8.0&auto=format&s=128afc6edc8b9bccacd5a6f5be90522e> (referer: None)
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e1e90>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Finterior_dashboard-1774691696796.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/interior_dashboard-1774691696796.jpeg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2fba50>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4032%252F20494032%252Fexterior_rear_passenger-1774721068066.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_passenger-1774721068066.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$y{\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xbe\xe4\x00$oi\x00\x00\x00\x00'
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d5ed0>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Finstrument_cluster-1774691722448.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/instrument_cluster-1774691722448.jpeg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\x97\x96\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xde\xf1\x00-\x8d\x84\x00\x00\x00\x00'
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c251b90>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9339%252F11969339%252Finterior_rear_seats-1774692281029.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9339/11969339/interior_rear_seats-1774692281029.jpeg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\xbc\n\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe1@\x000\xb1\xf8\x00\x00\x00\x00'
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e97b750>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9339%252F11969339%252Finterior_front_seats-1774691563752.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9339/11969339/interior_front_seats-1774691563752.jpeg saved to cache
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x0065b\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xfd.\x006+P\x00\x00\x00\x00'
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e977110>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9339%252F11969339%252Finterior_boot-1774691708249.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9339/11969339/interior_boot-1774691708249.jpeg saved to cache
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95cf10>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4459%252F18634459%252Fdocs_service_history-1774634371327.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D128afc6edc8b9bccacd5a6f5be90522e') HTTP/1.1" 204 0
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4459/18634459/docs_service_history-1774634371327.jpg?ixlib=js-3.8.0&auto=format&s=128afc6edc8b9bccacd5a6f5be90522e saved to cache
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0237/20490237/interior_dashboard-1774777994878.jpg> (referer: None)
2026-03-29 20:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0237/20490237/interior_rear_seats-1774710012705.jpg> (referer: None)
2026-03-29 20:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0237/20490237/damage_missing_trims-1774777766890.jpg> (referer: None)
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d211890>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0237%252F20490237%252Finterior_dashboard-1774777994878.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0237/20490237/interior_dashboard-1774777994878.jpg saved to cache
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20221098.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13a010>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0237%252F20490237%252Finterior_rear_seats-1774710012705.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0237/20490237/interior_rear_seats-1774710012705.jpg saved to cache
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2ac310>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0237%252F20490237%252Fdamage_missing_trims-1774777766890.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0237/20490237/damage_missing_trims-1774777766890.jpg saved to cache
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00966359-61b7-5b7a-a8fc-f31e6e43c463 with identifier: 20221098
2026-03-29 20:20:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00966359-61b7-5b7a-a8fc-f31e6e43c463 with scrape type 2
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00966359-61b7-5b7a-a8fc-f31e6e43c463 with scrape type 2
2026-03-29 20:20:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 00966359-61b7-5b7a-a8fc-f31e6e43c463, identifier: 20221098
2026-03-29 20:20:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 00966359-61b7-5b7a-a8fc-f31e6e43c463 with identifier: 20221098
2026-03-29 20:20:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 00966359-61b7-5b7a-a8fc-f31e6e43c463 with identifier: 20221098
2026-03-29 20:20:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 00966359-61b7-5b7a-a8fc-f31e6e43c463 with identifier: 20221098 to the API
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20221098.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '00966359-61b7-5b7a-a8fc-f31e6e43c463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'D9 LOL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20221098',
'listing': 'auction',
'location': 'Essex Southend-on-Sea',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 85100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 3774,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Citroen Berlingo 625 EN-PRISE BlueHDi',
'transmission': 'manual',
'trim': '625 EN-PRISE BlueHDi',
'vin': 'VF77BBHW6HJ777363',
'year': 2017}
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720221098%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [motorway.uk] INFO: Saving data for 20221098: {'auction_closing_time': 1774884600.0, 'created_time': 1774384976.938877, 'last_price_update_time': 1774815651.041641}
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20221098') HTTP/1.1" 204 0
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20456356.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_passenger-1774709600342.jpg> (referer: None)
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_driver-1774709574770.jpg> (referer: None)
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_passenger-1774709614225.jpg> (referer: None)
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_driver-1774709588197.jpg> (referer: None)
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4032/20494032/docs_service_history-1774775188815.jpg?ixlib=js-3.8.0&auto=format&s=04c7aa77c02df6ac8cbc3025833a07a2> (referer: None)
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0237/20490237/interior_front_seats-1774710002005.jpg> (referer: None)
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0237/20490237/interior_boot-1774710063081.jpg> (referer: None)
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 53c29919-9597-58b1-bc0b-23d74e9db710 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8c12946-a05c-521a-9089-c4ff684dfbb0 with identifier: 20456356
2026-03-29 20:20:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8c12946-a05c-521a-9089-c4ff684dfbb0 with scrape type 1
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_front_driver-1774699594828.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_driver-1774699594828.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_rear_driver-1774699611371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_driver-1774699611371.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_front_passenger-1774699631528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_passenger-1774699631528.jpg not downloaded yet
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02ff50>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_rear_passenger-1774709600342.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_passenger-1774709600342.jpg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec07550>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_front_driver-1774709574770.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_driver-1774709574770.jpg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5851d0>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_front_passenger-1774709614225.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_passenger-1774709614225.jpg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d586910>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0237%252F20490237%252Fexterior_rear_driver-1774709588197.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_driver-1774709588197.jpg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_rear_passenger-1774699619395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_passenger-1774699619395.jpg not downloaded yet
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20454557.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1c410>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4032%252F20494032%252Fdocs_service_history-1774775188815.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04c7aa77c02df6ac8cbc3025833a07a2') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4032/20494032/docs_service_history-1774775188815.jpg?ixlib=js-3.8.0&auto=format&s=04c7aa77c02df6ac8cbc3025833a07a2 saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe
2026-03-29 20:20:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf57d0>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0237%252F20490237%252Finterior_front_seats-1774710002005.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0237/20490237/interior_front_seats-1774710002005.jpg saved to cache
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9c9ad0>
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0237%252F20490237%252Finterior_boot-1774710063081.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0237/20490237/interior_boot-1774710063081.jpg saved to cache
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53c29919-9597-58b1-bc0b-23d74e9db710
2026-03-29 20:20:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53c29919-9597-58b1-bc0b-23d74e9db710, skipping ID generation
2026-03-29 20:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c29919-9597-58b1-bc0b-23d74e9db710 with scrape type 1
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53c29919-9597-58b1-bc0b-23d74e9db710 sending to next pipeline
2026-03-29 20:20:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 53c29919-9597-58b1-bc0b-23d74e9db710, identifier: 20490237
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6356%252F20456356%252Finterior_front_seats-1774699996124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6356/20456356/interior_front_seats-1774699996124.jpg not downloaded yet
2026-03-29 20:20:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 53c29919-9597-58b1-bc0b-23d74e9db710 with identifier: 20490237
2026-03-29 20:20:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 53c29919-9597-58b1-bc0b-23d74e9db710 with identifier: 20490237
2026-03-29 20:20:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 53c29919-9597-58b1-bc0b-23d74e9db710 with identifier: 20490237 to the API
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0237/20490237/interior_boot-1774710063081.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '53c29919-9597-58b1-bc0b-23d74e9db710',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GL71 JUW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490237',
'listing': 'auction',
'location': 'Kent New Romney',
'make': 'BMW',
'model': '4 Series',
'odometer': 42000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1507458,
'Height': 2247,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_driver-1774709574770.jpg',
'Width': 2996},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1846722,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_driver-1774709588197.jpg',
'Width': 3238},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1884469,
'Height': 2376,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_front_passenger-1774709614225.jpg',
'Width': 3168},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476194,
'Height': 2261,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0237/20490237/exterior_rear_passenger-1774709600342.jpg',
'Width': 3014},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3642990,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0237/20490237/interior_front_seats-1774710002005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3475185,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0237/20490237/interior_rear_seats-1774710012705.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340470,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0237/20490237/interior_dashboard-1774777994878.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4389883,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0237/20490237/interior_boot-1774710063081.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c29919-9597-58b1-bc0b-23d74e9db710/53c29919-9597-58b1-bc0b-23d74e9db710_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274080,
'Height': 750,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0237/20490237/damage_missing_trims-1774777766890.jpg',
'Width': 1000}],
'price': 23876,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 420I M Sport Auto',
'transmission': 'automatic',
'trim': '420I M Sport Auto',
'vin': 'WBA12AT0X0CJ03020',
'year': 2021}
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490237%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [motorway.uk] INFO: Saving data for 20490237: {'created_time': 1774815652.917792, 'last_price_update_time': 1774815652.917837, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490237') HTTP/1.1" 204 0
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9247330.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6356%252F20456356%252Finterior_rear_seats-1774700007870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6356/20456356/interior_rear_seats-1774700007870.jpg not downloaded yet
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=504&page=14&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9a743e-a267-5aad-a33a-542748afa6b0 with identifier: 20454557
2026-03-29 20:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9a743e-a267-5aad-a33a-542748afa6b0 with scrape type 1
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_front_driver-1774697551141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_driver-1774697551141.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Finterior_dashboard-1774700035391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/interior_dashboard-1774700035391.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_rear_driver-1774697549269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_rear_driver-1774697549269.jpg not downloaded yet
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Finstrument_cluster-1774700181545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/instrument_cluster-1774700181545.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_front_passenger-1774697546636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_passenger-1774697546636.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6356%252F20456356%252Finterior_boot-1774700034354.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6356/20456356/interior_boot-1774700034354.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_rear_passenger-1774697636304.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_rear_passenger-1774697636304.jpg not downloaded yet
2026-03-29 20:20:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04cab473-217c-5d51-a933-9afe165448f1 with identifier: 9247330
2026-03-29 20:20:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04cab473-217c-5d51-a933-9afe165448f1 with scrape type 1
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_front_driver-1769604719700.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_driver-1769604719700.jpeg not downloaded yet
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20480434
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20396926
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 10578729
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20367865
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20457058
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19559218
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719559218%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 19559218: 1
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fwheels_front_driver-1774699662449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/wheels_front_driver-1774699662449.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4557%252F20454557%252Finterior_front_seats-1774697973516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4557/20454557/interior_front_seats-1774697973516.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_rear_driver-1769604832078.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_driver-1769604832078.jpeg not downloaded yet
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19677086
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20487346
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20477373
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 17851318
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20277040
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20456360
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 18732558
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 5611886
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20341222
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720341222%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 20341222: 1
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_driver-1774697551141.jpg> (referer: None)
2026-03-29 20:20:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4557%252F20454557%252Finterior_rear_seats-1774697971440.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4557/20454557/interior_rear_seats-1774697971440.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_front_passenger-1769604744549.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_passenger-1769604744549.jpeg not downloaded yet
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 14816704
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 17084288
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20485139
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20087813
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 16608213
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20487775
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19936274
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19950167
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 15737342
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20202633
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19867021
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20331785
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720331785%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 20331785: 1
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Finterior_dashboard-1774698063777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/interior_dashboard-1774698063777.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_rear_passenger-1769604812715.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_passenger-1769604812715.jpeg not downloaded yet
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20471533
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19734644
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 16989772
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20488442
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20387458
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20469643
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20272813
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 7883635
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277883635%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 7883635: 1
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4557%252F20454557%252Finstrument_cluster-1774773485959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4557/20454557/instrument_cluster-1774773485959.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F9247330%252Finterior_front_seats-1769604860362.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/9247330/interior_front_seats-1769604860362.jpeg not downloaded yet
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20386196
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d301510>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_front_driver-1774697551141.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_driver-1774697551141.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4557%252F20454557%252Finterior_boot-1774697974700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4557/20454557/interior_boot-1774697974700.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7330%252F9247330%252F9247330-interior_rear_seats-modified-1774365323386.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7330/9247330/9247330-interior_rear_seats-modified-1774365323386.jpeg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fwheels_front_driver-1774697712145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/wheels_front_driver-1774697712145.jpg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F9247330%252Finterior_dashboard-1769605077010.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/9247330/interior_dashboard-1769605077010.jpeg not downloaded yet
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4032/20494032/interior_dashboard-1774775208905.jpg> (referer: None)
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F9247330%252Finstrument_cluster-1769617542749.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/9247330/instrument_cluster-1769617542749.jpeg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F9247330%252Finterior_boot-1769605108407.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/9247330/interior_boot-1769605108407.jpeg not downloaded yet
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7330%252F9247330%252Fdocs_service_history-1773511385192.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1923f046212cb70c827b5cbc0bf99744%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/9247330/docs_service_history-1773511385192.jpg?ixlib=js-3.8.0&auto=format&s=1923f046212cb70c827b5cbc0bf99744 not downloaded yet
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4032/20494032/interior_rear_seats-1774722541823.jpg> (referer: None)
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4032/20494032/interior_boot-1774722627730.jpg> (referer: None)
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_passenger-1774699619395.jpg> (referer: None)
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_passenger-1774699631528.jpg> (referer: None)
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_driver-1774699611371.jpg> (referer: None)
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e986310>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4032%252F20494032%252Finterior_dashboard-1774775208905.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4032/20494032/interior_dashboard-1774775208905.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1f7d0>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20494032%252Finterior_rear_seats-1774722541823.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20494032/interior_rear_seats-1774722541823.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdddd0>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4032%252F20494032%252Finterior_boot-1774722627730.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4032/20494032/interior_boot-1774722627730.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23fb10>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_rear_passenger-1774699619395.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_passenger-1774699619395.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3f90d0>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_front_passenger-1774699631528.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_passenger-1774699631528.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23c150>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Fexterior_rear_driver-1774699611371.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_driver-1774699611371.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/9247330/docs_service_history-1773511385192.jpg?ixlib=js-3.8.0&auto=format&s=1923f046212cb70c827b5cbc0bf99744> (referer: None)
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6356/20456356/interior_front_seats-1774699996124.jpg> (referer: None)
2026-03-29 20:20:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6356/20456356/interior_rear_seats-1774700007870.jpg> (referer: None)
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b8c12946-a05c-521a-9089-c4ff684dfbb0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca98950>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7330%252F9247330%252Fdocs_service_history-1773511385192.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1923f046212cb70c827b5cbc0bf99744') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/9247330/docs_service_history-1773511385192.jpg?ixlib=js-3.8.0&auto=format&s=1923f046212cb70c827b5cbc0bf99744 saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4557/20454557/wheels_front_driver-1774697712145.jpg> (referer: None)
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca213d0>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6356%252F20456356%252Finterior_front_seats-1774699996124.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6356/20456356/interior_front_seats-1774699996124.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d197250>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6356%252F20456356%252Finterior_rear_seats-1774700007870.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6356/20456356/interior_rear_seats-1774700007870.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4557/20454557/instrument_cluster-1774773485959.jpg> (referer: None)
2026-03-29 20:20:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 04cab473-217c-5d51-a933-9afe165448f1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16d8d0>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fwheels_front_driver-1774697712145.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/wheels_front_driver-1774697712145.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7330/9247330/9247330-interior_rear_seats-modified-1774365323386.jpeg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7330/9247330/instrument_cluster-1769617542749.jpeg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7330/9247330/interior_boot-1769605108407.jpeg> (referer: None)
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd6910>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4557%252F20454557%252Finstrument_cluster-1774773485959.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4557/20454557/instrument_cluster-1774773485959.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001\x854\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02f\x19\x001{&\x00\x00\x00\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16d250>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7330%252F9247330%252F9247330-interior_rear_seats-modified-1774365323386.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7330/9247330/9247330-interior_rear_seats-modified-1774365323386.jpeg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%5\xe7\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01ci\x00%+\x91\x00\x00\x00\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea852d0>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F9247330%252Finstrument_cluster-1769617542749.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/9247330/instrument_cluster-1769617542749.jpeg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x007s\xf0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03C\x94\x007i\xe2\x00\x00\x00\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceab7d0>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F9247330%252Finterior_boot-1769605108407.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/9247330/interior_boot-1769605108407.jpeg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 04cab473-217c-5d51-a933-9afe165448f1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 5a9a743e-a267-5aad-a33a-542748afa6b0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4557/20454557/interior_dashboard-1774698063777.jpg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4557/20454557/interior_rear_seats-1774697971440.jpg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_passenger-1769604744549.jpeg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_passenger-1769604812715.jpeg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19559218.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 11:40:50\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd59d0>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Finterior_dashboard-1774698063777.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/interior_dashboard-1774698063777.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 11:38:55\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c244890>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4557%252F20454557%252Finterior_rear_seats-1774697971440.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4557/20454557/interior_rear_seats-1774697971440.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d291790>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_front_passenger-1769604744549.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_passenger-1769604744549.jpeg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec44b50>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_rear_passenger-1769604812715.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_passenger-1769604812715.jpeg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747302aa-c0bf-5735-8494-940ef763802a with identifier: 19559218
2026-03-29 20:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747302aa-c0bf-5735-8494-940ef763802a with scrape type 1
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_front_driver-1774705770462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_driver-1774705770462.jpg not downloaded yet
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_rear_driver-1774705797203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_driver-1774705797203.jpg not downloaded yet
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_driver-1769604719700.jpeg> (referer: None)
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_front_passenger-1774705824955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_passenger-1774705824955.jpg not downloaded yet
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_passenger-1774697546636.jpg> (referer: None)
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_rear_passenger-1774705813297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_passenger-1774705813297.jpg not downloaded yet
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9218%252F19559218%252Finterior_front_seats-1774706201265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9218/19559218/interior_front_seats-1774706201265.jpg not downloaded yet
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9218%252F19559218%252Finterior_rear_seats-1774706256678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9218/19559218/interior_rear_seats-1774706256678.jpg not downloaded yet
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Finterior_dashboard-1774706283785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/interior_dashboard-1774706283785.jpg not downloaded yet
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Finstrument_cluster-1774706300538.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/instrument_cluster-1774706300538.jpg not downloaded yet
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4557/20454557/interior_front_seats-1774697973516.jpg> (referer: None)
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9218%252F19559218%252Finterior_boot-1774706410086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9218/19559218/interior_boot-1774706410086.jpg not downloaded yet
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d184690>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_front_driver-1769604719700.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_driver-1769604719700.jpeg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9218%252F19559218%252Fdocs_service_history-1774706523696.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9f4f87adc0b82f845889cb77147539c%27 HTTP/1.1" 200 None
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9218/19559218/docs_service_history-1774706523696.jpg?ixlib=js-3.8.0&auto=format&s=f9f4f87adc0b82f845889cb77147539c not downloaded yet
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea54c50>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_front_passenger-1774697546636.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_passenger-1774697546636.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 11:38:39\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00f010>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4557%252F20454557%252Finterior_front_seats-1774697973516.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4557/20454557/interior_front_seats-1774697973516.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_driver-1769604832078.jpeg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_driver-1774705770462.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_driver-1774705797203.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6356/20456356/instrument_cluster-1774700181545.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6356/20456356/interior_boot-1774700034354.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9218/19559218/docs_service_history-1774706523696.jpg?ixlib=js-3.8.0&auto=format&s=f9f4f87adc0b82f845889cb77147539c> (referer: None)
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e979910>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F9247330%252Fexterior_rear_driver-1769604832078.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_driver-1769604832078.jpeg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04cab473-217c-5d51-a933-9afe165448f1
2026-03-29 20:20:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04cab473-217c-5d51-a933-9afe165448f1, skipping ID generation
2026-03-29 20:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04cab473-217c-5d51-a933-9afe165448f1 with scrape type 1
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04cab473-217c-5d51-a933-9afe165448f1 sending to next pipeline
2026-03-29 20:20:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 04cab473-217c-5d51-a933-9afe165448f1, identifier: 9247330
2026-03-29 20:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 04cab473-217c-5d51-a933-9afe165448f1 with identifier: 9247330
2026-03-29 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 04cab473-217c-5d51-a933-9afe165448f1 with identifier: 9247330
2026-03-29 20:20:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 04cab473-217c-5d51-a933-9afe165448f1 with identifier: 9247330 to the API
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_driver-1769604832078.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '04cab473-217c-5d51-a933-9afe165448f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WU66 UOL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9247330',
'listing': 'auction',
'location': 'Warwickshire Kenilworth',
'make': 'Volkswagen',
'model': 'Up!',
'odometer': 52102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548082,
'Height': 2442,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_driver-1769604719700.jpeg',
'Width': 3256},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1633478,
'Height': 2527,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_driver-1769604832078.jpeg',
'Width': 3369},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1434808,
'Height': 2398,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_front_passenger-1769604744549.jpeg',
'Width': 3197},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1437290,
'Height': 2430,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/9247330/exterior_rear_passenger-1769604812715.jpeg',
'Width': 3240},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1805712,
'Height': 2502,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7330/9247330/9247330-interior_rear_seats-modified-1774365323386.jpeg',
'Width': 3336},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2529616,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7330/9247330/instrument_cluster-1769617542749.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3848068,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7330/9247330/interior_boot-1769605108407.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cab473-217c-5d51-a933-9afe165448f1/04cab473-217c-5d51-a933-9afe165448f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1009415,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/9247330/docs_service_history-1773511385192.jpg?ixlib=js-3.8.0&auto=format&s=1923f046212cb70c827b5cbc0bf99744',
'Width': 4000}],
'price': 4970,
'price_includes_vat': False,
'registration_date': '2016-09-13',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen up! BY Beats',
'transmission': 'manual',
'trim': 'up! BY Beats',
'vin': 'WVWZZZAAZHD011940',
'year': 2016}
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279247330%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [motorway.uk] INFO: Saving data for 9247330: {'created_time': 1774815657.542184, 'last_price_update_time': 1774815657.542194, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9247330') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b8c12946-a05c-521a-9089-c4ff684dfbb0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 5a9a743e-a267-5aad-a33a-542748afa6b0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0eea90>
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_front_driver-1774705770462.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_driver-1774705770462.jpg saved to cache
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf02110>
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_rear_driver-1774705797203.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_driver-1774705797203.jpg saved to cache
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d779810>
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6356%252F20456356%252Finstrument_cluster-1774700181545.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6356/20456356/instrument_cluster-1774700181545.jpg saved to cache
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf001d0>
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6356%252F20456356%252Finterior_boot-1774700034354.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6356/20456356/interior_boot-1774700034354.jpg saved to cache
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8c12946-a05c-521a-9089-c4ff684dfbb0
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7c650>
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9218%252F19559218%252Fdocs_service_history-1774706523696.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9f4f87adc0b82f845889cb77147539c') HTTP/1.1" 204 0
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9218/19559218/docs_service_history-1774706523696.jpg?ixlib=js-3.8.0&auto=format&s=f9f4f87adc0b82f845889cb77147539c saved to cache
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 747302aa-c0bf-5735-8494-940ef763802a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20171226.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18543563.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d005c8fa-b876-5cf7-965e-ce6be132cfe8 with identifier: 20171226
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d005c8fa-b876-5cf7-965e-ce6be132cfe8 with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Fexterior_front_driver-1773074743540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_driver-1773074743540.jpg not downloaded yet
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cabe4627-1893-53dd-a5cb-f7480507fe66 with identifier: 18543563
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cabe4627-1893-53dd-a5cb-f7480507fe66 with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_front_driver-1774621810072.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_driver-1774621810072.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1226%252F20171226%252Fexterior_rear_driver-1772990104153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_driver-1772990104153.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_rear_driver-1774621832361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_driver-1774621832361.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Fexterior_front_passenger-1773074792087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_passenger-1773074792087.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_front_passenger-1774621852395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_passenger-1774621852395.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1226%252F20171226%252Fexterior_rear_passenger-1772990117193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_passenger-1772990117193.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_rear_passenger-1774621840366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_passenger-1774621840366.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1226%252F20171226%252Finterior_front_seats-1772990406817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1226/20171226/interior_front_seats-1772990406817.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3563%252F18543563%252Finterior_front_seats-1774622224116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3563/18543563/interior_front_seats-1774622224116.jpg not downloaded yet
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10452717.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_rear_driver-1774697549269.jpg> (referer: None)
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1226%252F20171226%252Finterior_rear_seats-1772990422123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1226/20171226/interior_rear_seats-1772990422123.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3563%252F18543563%252Finterior_rear_seats-1774622239723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3563/18543563/interior_rear_seats-1774622239723.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Finterior_dashboard-1773074824513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/interior_dashboard-1773074824513.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Finterior_dashboard-1774622381218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/interior_dashboard-1774622381218.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1226%252F20171226%252Finterior_boot-1772990462307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1226/20171226/interior_boot-1772990462307.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Finstrument_cluster-1774622281855.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/instrument_cluster-1774622281855.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1226%252F20171226%252Fdocs_service_history-1772990591126.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13a2c85674d1819d2583ca5d5490ef4e%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1226/20171226/docs_service_history-1772990591126.jpg?ixlib=js-3.8.0&auto=format&s=13a2c85674d1819d2583ca5d5490ef4e not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3563%252F18543563%252Finterior_boot-1774622350517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3563/18543563/interior_boot-1774622350517.jpg not downloaded yet
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc33de05-2970-521b-aa4a-fc3e48f85b43 with identifier: 10452717
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc33de05-2970-521b-aa4a-fc3e48f85b43 with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2717%252F10452717%252Fexterior_front_driver-1774696661954.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2717/10452717/exterior_front_driver-1774696661954.jpeg not downloaded yet
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7f88d0>
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4557%252F20454557%252Fexterior_rear_driver-1774697549269.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_rear_driver-1774697549269.jpg saved to cache
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a9a743e-a267-5aad-a33a-542748afa6b0
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a9a743e-a267-5aad-a33a-542748afa6b0, skipping ID generation
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9a743e-a267-5aad-a33a-542748afa6b0 with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a9a743e-a267-5aad-a33a-542748afa6b0 sending to next pipeline
2026-03-29 20:20:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5a9a743e-a267-5aad-a33a-542748afa6b0, identifier: 20454557
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Fdamage_scratches-1773074100501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/damage_scratches-1773074100501.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3563%252F18543563%252Fdocs_service_history-1774622728428.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D875c4883d710001e926406c3a119d923%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3563/18543563/docs_service_history-1774622728428.jpg?ixlib=js-3.8.0&auto=format&s=875c4883d710001e926406c3a119d923 not downloaded yet
2026-03-29 20:20:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5a9a743e-a267-5aad-a33a-542748afa6b0 with identifier: 20454557
2026-03-29 20:20:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5a9a743e-a267-5aad-a33a-542748afa6b0 with identifier: 20454557
2026-03-29 20:20:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5a9a743e-a267-5aad-a33a-542748afa6b0 with identifier: 20454557 to the API
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_rear_driver-1774697549269.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5a9a743e-a267-5aad-a33a-542748afa6b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC24 MKN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20454557',
'listing': 'auction',
'location': 'Oxfordshire Chinnor',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 12870,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131557,
'Height': 729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_driver-1774697551141.jpg',
'Width': 972},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137349,
'Height': 725,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_rear_driver-1774697549269.jpg',
'Width': 967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210431,
'Height': 803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4557/20454557/exterior_front_passenger-1774697546636.jpg',
'Width': 1071},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 953271,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/4557/20454557/interior_front_seats-1774697973516.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 895076,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/4557/20454557/interior_rear_seats-1774697971440.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750432,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4557/20454557/interior_dashboard-1774698063777.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268453,
'Height': 1078,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4557/20454557/instrument_cluster-1774773485959.jpg',
'Width': 1438},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9a743e-a267-5aad-a33a-542748afa6b0/5a9a743e-a267-5aad-a33a-542748afa6b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188451,
'Height': 871,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4557/20454557/wheels_front_driver-1774697712145.jpg',
'Width': 1161}],
'price': 23000,
'price_includes_vat': False,
'registration_date': '2024-08-07',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-Roc R-LINE TSI S-A',
'transmission': 'automatic',
'trim': 'R-LINE TSI S-A',
'vin': 'WVGZZZA15RV221548',
'year': 2024}
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454557%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [motorway.uk] INFO: Saving data for 20454557: {'created_time': 1774815659.489971, 'last_price_update_time': 1774815659.489985, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20454557') HTTP/1.1" 204 0
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-exterior_rear_driver-modified-1774698392287.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_driver-modified-1774698392287.jpeg not downloaded yet
2026-03-29 20:20:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.877(s), this was the 1st time calling it.
2026-03-29 20:20:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.456516750673141 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-exterior_front_passenger-modified-1774698403322.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_front_passenger-modified-1774698403322.jpeg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-exterior_rear_passenger-modified-1774698413063.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_passenger-modified-1774698413063.jpeg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-interior_front_seats-modified-1774698428841.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-interior_front_seats-modified-1774698428841.jpeg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2717%252F10452717%252Finterior_rear_seats-1774696851007.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2717/10452717/interior_rear_seats-1774696851007.jpeg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2717%252F10452717%252Finterior_dashboard-1774696924985.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2717/10452717/interior_dashboard-1774696924985.jpeg not downloaded yet
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:20:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b8c12946-a05c-521a-9089-c4ff684dfbb0 with identifier: 20456356
2026-03-29 20:20:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b8c12946-a05c-521a-9089-c4ff684dfbb0 with identifier: 20456356
2026-03-29 20:20:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b8c12946-a05c-521a-9089-c4ff684dfbb0 with identifier: 20456356 to the API
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:59 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '0.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b8c12946-a05c-521a-9089-c4ff684dfbb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY67 MXN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20456356',
'listing': 'auction',
'location': 'Telford and Wrekin Telford',
'make': 'BMW',
'model': 'i3',
'odometer': 84000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_driver-1774699594828.jpg',
'https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_driver-1774699611371.jpg',
'https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_passenger-1774699631528.jpg',
'https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_passenger-1774699619395.jpg',
'https://motorway-photos.imgix.net/6356/20456356/interior_front_seats-1774699996124.jpg',
'https://motorway-photos.imgix.net/6356/20456356/interior_rear_seats-1774700007870.jpg',
'https://motorway-photos-redacted.imgix.net/6356/20456356/interior_dashboard-1774700035391.jpg',
'https://motorway-photos-redacted.imgix.net/6356/20456356/instrument_cluster-1774700181545.jpg',
'https://motorway-photos.imgix.net/6356/20456356/interior_boot-1774700034354.jpg',
'https://motorway-photos-redacted.imgix.net/6356/20456356/wheels_front_driver-1774699662449.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1785688,
'Height': 2496,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_driver-1774699611371.jpg',
'Width': 3328},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1791920,
'Height': 2663,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_front_passenger-1774699631528.jpg',
'Width': 3551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1676470,
'Height': 2563,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6356/20456356/exterior_rear_passenger-1774699619395.jpg',
'Width': 3417},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3870654,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6356/20456356/interior_front_seats-1774699996124.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4463707,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6356/20456356/interior_rear_seats-1774700007870.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2518696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6356/20456356/instrument_cluster-1774700181545.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c12946-a05c-521a-9089-c4ff684dfbb0/b8c12946-a05c-521a-9089-c4ff684dfbb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3744810,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6356/20456356/interior_boot-1774700034354.jpg',
'Width': 4032}],
'price': 5418,
'price_includes_vat': False,
'registration_date': '2017-09-08',
'seats_number': None,
'seller_name': None,
'title': 'BMW i3 Range Extender',
'transmission': 'automatic',
'trim': 'Range Extender',
'vin': 'WBY1Z820X0V960112',
'year': 2017}
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456356%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Saving data for 20456356: {'created_time': 1774815660.010585, 'last_price_update_time': 1774815660.0106, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20456356') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 027c7b50-13fc-5eba-8be4-5f0294aac0fe with identifier: 20494032
2026-03-29 20:21:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 027c7b50-13fc-5eba-8be4-5f0294aac0fe with identifier: 20494032
2026-03-29 20:21:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 027c7b50-13fc-5eba-8be4-5f0294aac0fe with identifier: 20494032 to the API
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '027c7b50-13fc-5eba-8be4-5f0294aac0fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO74 RUH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20494032',
'listing': 'auction',
'location': 'Essex Wickford',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 13346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_front_driver-1774721109850.jpg',
'https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_driver-1774721083129.jpg',
'https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_front_passenger-1774721049047.jpg',
'https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_passenger-1774721068066.jpg',
'https://motorway-photos.imgix.net/4032/20494032/interior_front_seats-1774722351118.jpg',
'https://motorway-photos.imgix.net/4032/20494032/interior_rear_seats-1774722541823.jpg',
'https://motorway-photos-modified.imgix.net/4032/20494032/interior_dashboard-1774775208905.jpg',
'https://motorway-photos-redacted.imgix.net/4032/20494032/instrument_cluster-1774722399152.jpg',
'https://motorway-photos.imgix.net/4032/20494032/interior_boot-1774722627730.jpg',
'https://motorway-service-history-photos.imgix.net/modified/4032/20494032/docs_service_history-1774775188815.jpg?ixlib=js-3.8.0&auto=format&s=04c7aa77c02df6ac8cbc3025833a07a2'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1198057,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4032/20494032/exterior_rear_passenger-1774721068066.jpg',
'Width': 3217},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2704478,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4032/20494032/interior_rear_seats-1774722541823.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1978644,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4032/20494032/interior_dashboard-1774775208905.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3091920,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4032/20494032/interior_boot-1774722627730.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_027c7b50-13fc-5eba-8be4-5f0294aac0fe/027c7b50-13fc-5eba-8be4-5f0294aac0fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3378600,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4032/20494032/docs_service_history-1774775188815.jpg?ixlib=js-3.8.0&auto=format&s=04c7aa77c02df6ac8cbc3025833a07a2',
'Width': 4284}],
'price': 25700,
'price_includes_vat': False,
'registration_date': '2024-11-26',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R-LINE TDI S-A',
'transmission': 'automatic',
'trim': 'R-LINE TDI S-A',
'vin': 'WVWZZZCD1SW008723',
'year': 2024}
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494032%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Saving data for 20494032: {'created_time': 1774815660.42308, 'last_price_update_time': 1774815660.423091, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20494032') HTTP/1.1" 204 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2717%252F10452717%252Finstrument_cluster-1774696962751.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2717/10452717/instrument_cluster-1774696962751.jpeg not downloaded yet
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item b8c12946-a05c-521a-9089-c4ff684dfbb0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 027c7b50-13fc-5eba-8be4-5f0294aac0fe due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_passenger-1774705813297.jpg> (referer: None)
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2717%252F10452717%252Finterior_boot-1774696964501.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2717/10452717/interior_boot-1774696964501.jpeg not downloaded yet
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9218/19559218/interior_dashboard-1774706283785.jpg> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1226/20171226/damage_scratches-1773074100501.jpg> (referer: None)
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2717%252F10452717%252F10452717-docs_service_history-default-1774541539404.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dce77008be862624b4346ad14eb22ea05%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2717/10452717/10452717-docs_service_history-default-1774541539404.jpeg?ixlib=js-3.8.0&auto=format&s=ce77008be862624b4346ad14eb22ea05 not downloaded yet
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3563/18543563/docs_service_history-1774622728428.jpg?ixlib=js-3.8.0&auto=format&s=875c4883d710001e926406c3a119d923> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9218/19559218/interior_rear_seats-1774706256678.jpg> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_passenger-1774705824955.jpg> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9218/19559218/interior_front_seats-1774706201265.jpg> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9218/19559218/interior_boot-1774706410086.jpg> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_driver-modified-1774698392287.jpeg> (referer: None)
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3563/18543563/interior_front_seats-1774622224116.jpg> (referer: None)
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d784c90>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_rear_passenger-1774705813297.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_passenger-1774705813297.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c20c650>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Finterior_dashboard-1774706283785.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/interior_dashboard-1774706283785.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54c650>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Fdamage_scratches-1773074100501.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/damage_scratches-1773074100501.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1612d0>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3563%252F18543563%252Fdocs_service_history-1774622728428.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D875c4883d710001e926406c3a119d923') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3563/18543563/docs_service_history-1774622728428.jpg?ixlib=js-3.8.0&auto=format&s=875c4883d710001e926406c3a119d923 saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54cc10>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9218%252F19559218%252Finterior_rear_seats-1774706256678.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9218/19559218/interior_rear_seats-1774706256678.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c20fe10>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9218%252F19559218%252Fexterior_front_passenger-1774705824955.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_passenger-1774705824955.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1a3d0>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9218%252F19559218%252Finterior_front_seats-1774706201265.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9218/19559218/interior_front_seats-1774706201265.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1635d0>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9218%252F19559218%252Finterior_boot-1774706410086.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9218/19559218/interior_boot-1774706410086.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747302aa-c0bf-5735-8494-940ef763802a
2026-03-29 20:21:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747302aa-c0bf-5735-8494-940ef763802a, skipping ID generation
2026-03-29 20:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747302aa-c0bf-5735-8494-940ef763802a with scrape type 1
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747302aa-c0bf-5735-8494-940ef763802a sending to next pipeline
2026-03-29 20:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 747302aa-c0bf-5735-8494-940ef763802a, identifier: 19559218
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb96e50>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-exterior_rear_driver-modified-1774698392287.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_driver-modified-1774698392287.jpeg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d055790>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3563%252F18543563%252Finterior_front_seats-1774622224116.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3563/18543563/interior_front_seats-1774622224116.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 747302aa-c0bf-5735-8494-940ef763802a with identifier: 19559218
2026-03-29 20:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 747302aa-c0bf-5735-8494-940ef763802a with identifier: 19559218
2026-03-29 20:21:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 747302aa-c0bf-5735-8494-940ef763802a with identifier: 19559218 to the API
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9218/19559218/interior_boot-1774706410086.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '747302aa-c0bf-5735-8494-940ef763802a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LM21 NVE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19559218',
'listing': 'auction',
'location': 'Surrey Walton-on-Thames',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192208,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_driver-1774705770462.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2249356,
'Height': 2673,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_driver-1774705797203.jpg',
'Width': 3564},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2778169,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_front_passenger-1774705824955.jpg',
'Width': 3495},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1566080,
'Height': 2316,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9218/19559218/exterior_rear_passenger-1774705813297.jpg',
'Width': 3088},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3266446,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9218/19559218/interior_front_seats-1774706201265.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3109995,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9218/19559218/interior_rear_seats-1774706256678.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1803271,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9218/19559218/interior_dashboard-1774706283785.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3696579,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9218/19559218/interior_boot-1774706410086.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747302aa-c0bf-5735-8494-940ef763802a/747302aa-c0bf-5735-8494-940ef763802a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85375,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9218/19559218/docs_service_history-1774706523696.jpg?ixlib=js-3.8.0&auto=format&s=f9f4f87adc0b82f845889cb77147539c',
'Width': 596}],
'price': 13589,
'price_includes_vat': False,
'registration_date': '2021-08-06',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 250 AMG Line Edition E Auto',
'transmission': 'automatic',
'trim': 'A 250 AMG Line Edition E Auto',
'vin': 'W1K1771862J325561',
'year': 2021}
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719559218%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Saving data for 19559218: {'created_time': 1774815662.16006, 'last_price_update_time': 1774815662.160071, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19559218') HTTP/1.1" 204 0
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=540&page=15&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2717/10452717/interior_dashboard-1774696924985.jpeg> (referer: None)
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2717/10452717/10452717-interior_front_seats-modified-1774698428841.jpeg> (referer: None)
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2717/10452717/instrument_cluster-1774696962751.jpeg> (referer: None)
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2717/10452717/10452717-docs_service_history-default-1774541539404.jpeg?ixlib=js-3.8.0&auto=format&s=ce77008be862624b4346ad14eb22ea05> (referer: None)
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item cc33de05-2970-521b-aa4a-fc3e48f85b43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item cc33de05-2970-521b-aa4a-fc3e48f85b43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20301561
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20480470
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20025955
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 19072079
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20478414
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20390094
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720390094%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20390094: 1
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20355039
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720355039%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20355039: 1
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 19897967
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20416855
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20036264
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720036264%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20036264: 1
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacae50>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2717%252F10452717%252Finterior_dashboard-1774696924985.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2717/10452717/interior_dashboard-1774696924985.jpeg saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c656bd0>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-interior_front_seats-modified-1774698428841.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-interior_front_seats-modified-1774698428841.jpeg saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20463207
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 18730909
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20382318
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20398514
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20484917
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 18872105
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 19791860
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 18667851
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718667851%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 18667851: 1
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xf2Z\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x020\xa0\x00*\xe7\xca\x00\x00\x00\x00'
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce26f50>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2717%252F10452717%252Finstrument_cluster-1774696962751.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2717/10452717/instrument_cluster-1774696962751.jpeg saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 9844685
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 16823030
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716823030%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 16823030: 1
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 22 - Data Location: 98 - value: b'Screenshot\x00'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 110 - value: b'\x00\x00\x00\x90\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 118 - value: b'\x00\x00\x00\x90\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 82 - Data Location: 126 - value: b'2026:03:25 15:48:04\x00'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x92'
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d1010>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2717%252F10452717%252F10452717-docs_service_history-default-1774541539404.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dce77008be862624b4346ad14eb22ea05') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2717/10452717/10452717-docs_service_history-default-1774541539404.jpeg?ixlib=js-3.8.0&auto=format&s=ce77008be862624b4346ad14eb22ea05 saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20408961
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720408961%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20408961: 1
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1226/20171226/docs_service_history-1772990591126.jpg?ixlib=js-3.8.0&auto=format&s=13a2c85674d1819d2583ca5d5490ef4e> (referer: None)
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20296127
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20222166
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20474874
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 12127571
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712127571%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 12127571: 1
2026-03-29 20:21:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20483047
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483047%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20483047: 1
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 17857405
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 17585425
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20401950
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401950%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20401950: 1
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 15315241
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20394022
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20239538
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20066529
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 2726366
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272726366%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 2726366: 1
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 20047376
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720047376%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 20047376: 1
2026-03-29 20:21:02 [motorway.uk] INFO: Found listing with ID: 19669988
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719669988%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [motorway.uk] INFO: Scrape type for 19669988: 1
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce27b10>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1226%252F20171226%252Fdocs_service_history-1772990591126.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13a2c85674d1819d2583ca5d5490ef4e') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1226/20171226/docs_service_history-1772990591126.jpg?ixlib=js-3.8.0&auto=format&s=13a2c85674d1819d2583ca5d5490ef4e saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3563/18543563/instrument_cluster-1774622281855.jpg> (referer: None)
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_passenger-modified-1774698413063.jpeg> (referer: None)
2026-03-29 20:21:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2717/10452717/exterior_front_driver-1774696661954.jpeg> (referer: None)
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1226/20171226/interior_boot-1772990462307.jpg> (referer: None)
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3563/18543563/interior_boot-1774622350517.jpg> (referer: None)
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3563/18543563/interior_rear_seats-1774622239723.jpg> (referer: None)
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc01410>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Finstrument_cluster-1774622281855.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/instrument_cluster-1774622281855.jpg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edbad10>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2717%252F10452717%252F10452717-exterior_rear_passenger-modified-1774698413063.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_passenger-modified-1774698413063.jpeg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c216c90>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2717%252F10452717%252Fexterior_front_driver-1774696661954.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2717/10452717/exterior_front_driver-1774696661954.jpeg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc33de05-2970-521b-aa4a-fc3e48f85b43
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d241e10>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1226%252F20171226%252Finterior_boot-1772990462307.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1226/20171226/interior_boot-1772990462307.jpg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d1610>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3563%252F18543563%252Finterior_boot-1774622350517.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3563/18543563/interior_boot-1774622350517.jpg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2725d0>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3563%252F18543563%252Finterior_rear_seats-1774622239723.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3563/18543563/interior_rear_seats-1774622239723.jpg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:21:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cc33de05-2970-521b-aa4a-fc3e48f85b43 with identifier: 10452717
2026-03-29 20:21:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cc33de05-2970-521b-aa4a-fc3e48f85b43 with identifier: 10452717
2026-03-29 20:21:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cc33de05-2970-521b-aa4a-fc3e48f85b43 with identifier: 10452717 to the API
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:04 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cc33de05-2970-521b-aa4a-fc3e48f85b43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB69 XSL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10452717',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Jaguar',
'model': 'XE Series',
'odometer': 21800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/2717/10452717/exterior_front_driver-1774696661954.jpeg',
'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_driver-modified-1774698392287.jpeg',
'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_front_passenger-modified-1774698403322.jpeg',
'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_passenger-modified-1774698413063.jpeg',
'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-interior_front_seats-modified-1774698428841.jpeg',
'https://motorway-photos.imgix.net/2717/10452717/interior_rear_seats-1774696851007.jpeg',
'https://motorway-photos-redacted.imgix.net/2717/10452717/interior_dashboard-1774696924985.jpeg',
'https://motorway-photos-redacted.imgix.net/2717/10452717/instrument_cluster-1774696962751.jpeg',
'https://motorway-photos.imgix.net/2717/10452717/interior_boot-1774696964501.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/2717/10452717/10452717-docs_service_history-default-1774541539404.jpeg?ixlib=js-3.8.0&auto=format&s=ce77008be862624b4346ad14eb22ea05'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421142,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2717/10452717/exterior_front_driver-1774696661954.jpeg',
'Width': 3471},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2104024,
'Height': 2314,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_driver-modified-1774698392287.jpeg',
'Width': 3085},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2323979,
'Height': 2399,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-exterior_rear_passenger-modified-1774698413063.jpeg',
'Width': 3199},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2509919,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2717/10452717/10452717-interior_front_seats-modified-1774698428841.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1533630,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2717/10452717/interior_dashboard-1774696924985.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2958074,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2717/10452717/instrument_cluster-1774696962751.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc33de05-2970-521b-aa4a-fc3e48f85b43/cc33de05-2970-521b-aa4a-fc3e48f85b43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192516,
'Height': 1699,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2717/10452717/10452717-docs_service_history-default-1774541539404.jpeg?ixlib=js-3.8.0&auto=format&s=ce77008be862624b4346ad14eb22ea05',
'Width': 1206}],
'price': 20438,
'price_includes_vat': False,
'registration_date': '2020-01-03',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE R-DYNAMIC HSE Auto',
'transmission': 'automatic',
'trim': 'XE R-DYNAMIC HSE Auto',
'vin': 'SAJAB4AX8LCP62319',
'year': 2020}
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710452717%27 HTTP/1.1" 200 None
2026-03-29 20:21:04 [motorway.uk] INFO: Saving data for 10452717: {'created_time': 1774815664.43239, 'last_price_update_time': 1774815664.432405, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10452717') HTTP/1.1" 204 0
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item cabe4627-1893-53dd-a5cb-f7480507fe66 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item cc33de05-2970-521b-aa4a-fc3e48f85b43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20408961.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc6d10b-3d77-5de9-83de-a9e8a44db89f with identifier: 20408961
2026-03-29 20:21:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f with scrape type 1
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_front_driver-1774701636610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_driver-1774701636610.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_rear_driver-1774701606837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_driver-1774701606837.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_front_passenger-1774701626187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_passenger-1774701626187.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_rear_passenger-1774701613443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_passenger-1774701613443.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8961%252F20408961%252Finterior_front_seats-1774704068109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8961/20408961/interior_front_seats-1774704068109.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8961%252F20408961%252Finterior_rear_seats-1774704642860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8961/20408961/interior_rear_seats-1774704642860.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8961%252F20408961%252Finterior_dashboard-1774704651600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8961/20408961/interior_dashboard-1774704651600.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Finstrument_cluster-1774702355675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/instrument_cluster-1774702355675.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8961%252F20408961%252Finterior_boot-1774704090928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8961/20408961/interior_boot-1774704090928.jpg not downloaded yet
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8961%252F20408961%252Fdocs_service_history-1774704131026.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dddf47a1d8f8e59bbac2ab5787bb9bba3%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8961/20408961/docs_service_history-1774704131026.jpg?ixlib=js-3.8.0&auto=format&s=ddf47a1d8f8e59bbac2ab5787bb9bba3 not downloaded yet
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=576&page=16&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19821442
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 14648195
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20442579
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19708166
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20460964
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20264228
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 15594477
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20307515
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720307515%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20307515: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20481960
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481960%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20481960: 1
2026-03-29 20:21:05 [scrapy.extensions.logstats] INFO: Crawled 156 pages (at 33 pages/min), scraped 128 items (at 20 items/min)
2026-03-29 20:21:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 15910710
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19313899
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20338223
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720338223%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20338223: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 18332731
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718332731%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 18332731: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20355749
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 10308764
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20467839
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467839%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20467839: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 17807552
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20191585
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20484266
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484266%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20484266: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 18989112
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718989112%27 HTTP/1.1" 200 None
2026-03-29 20:21:06 [motorway.uk] INFO: Scrape type for 18989112: 1
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20444774
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720444774%27 HTTP/1.1" 200 None
2026-03-29 20:21:06 [motorway.uk] INFO: Scrape type for 20444774: 1
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 13523395
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 18011097
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 5866923
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20468575
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 11768479
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 14717398
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714717398%27 HTTP/1.1" 200 None
2026-03-29 20:21:06 [motorway.uk] INFO: Scrape type for 14717398: 1
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20455953
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20240624
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 18507220
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 17656743
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20131585
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20444590
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720444590%27 HTTP/1.1" 200 None
2026-03-29 20:21:06 [motorway.uk] INFO: Scrape type for 20444590: 1
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20396560
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 20484632
2026-03-29 20:21:06 [motorway.uk] INFO: Found listing with ID: 2939803
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272939803%27 HTTP/1.1" 200 None
2026-03-29 20:21:06 [motorway.uk] INFO: Scrape type for 2939803: 1
2026-03-29 20:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8961/20408961/docs_service_history-1774704131026.jpg?ixlib=js-3.8.0&auto=format&s=ddf47a1d8f8e59bbac2ab5787bb9bba3> (referer: None)
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x12\x10'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\r\x8c'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A715F\x00'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 196 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'A715FXXSBDXB1\x00'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 218 - value: b'2026:03:28 13:11:50\x00'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xee'
2026-03-29 20:21:06 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x1e'
2026-03-29 20:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec9d7d0>
2026-03-29 20:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8961%252F20408961%252Fdocs_service_history-1774704131026.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dddf47a1d8f8e59bbac2ab5787bb9bba3') HTTP/1.1" 204 0
2026-03-29 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8961/20408961/docs_service_history-1774704131026.jpg?ixlib=js-3.8.0&auto=format&s=ddf47a1d8f8e59bbac2ab5787bb9bba3 saved to cache
2026-03-29 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20341222.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f04c35-001f-522f-93b8-88a24e915e66 with identifier: 20341222
2026-03-29 20:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f04c35-001f-522f-93b8-88a24e915e66 with scrape type 1
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_front_driver-1774700871001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_driver-1774700871001.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_rear_driver-1774700865959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_driver-1774700865959.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_front_passenger-1774700868980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_passenger-1774700868980.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_rear_passenger-1774700864469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_passenger-1774700864469.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1222%252F20341222%252Finterior_front_seats-1774711548127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1222/20341222/interior_front_seats-1774711548127.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1222%252F20341222%252Finterior_rear_seats-1774701270659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1222/20341222/interior_rear_seats-1774701270659.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1222%252F20341222%252Finterior_dashboard-1774711566190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1222/20341222/interior_dashboard-1774711566190.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Finstrument_cluster-1774701304058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/instrument_cluster-1774701304058.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1222%252F20341222%252Finterior_boot-1774711582262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1222/20341222/interior_boot-1774711582262.jpg not downloaded yet
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1222%252F20341222%252Fdocs_service_history-1774701325400.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db44301b621438367d2575ed8265471de%27 HTTP/1.1" 200 None
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1222/20341222/docs_service_history-1774701325400.jpg?ixlib=js-3.8.0&auto=format&s=b44301b621438367d2575ed8265471de not downloaded yet
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7883635.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a637bcd-a141-50f1-b025-2d8408f40a57 with identifier: 7883635
2026-03-29 20:21:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a637bcd-a141-50f1-b025-2d8408f40a57 with scrape type 1
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252Fexterior_front_driver-1774603849197.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_front_driver-1774603849197.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252Fexterior_rear_driver-1774604261175.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_rear_driver-1774604261175.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3635%252F7883635%252F7883635-exterior_front_passenger-modified-1774607200596.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3635/7883635/7883635-exterior_front_passenger-modified-1774607200596.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252F7883635-exterior_rear_passenger-default-1774608101996.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/7883635-exterior_rear_passenger-default-1774608101996.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3635%252F7883635%252Finterior_front_seats-1774605424619.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3635/7883635/interior_front_seats-1774605424619.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3635%252F7883635%252Finterior_rear_seats-1774605044125.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3635/7883635/interior_rear_seats-1774605044125.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252Finterior_dashboard-1774605156168.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/interior_dashboard-1774605156168.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3635%252F7883635%252Finterior_boot-1774604895495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3635/7883635/interior_boot-1774604895495.jpeg not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3635%252F7883635%252F7883635-docs_service_history-modified-1774607595074.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da8e78c350885887343414a032248dc84%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607595074.jpeg?ixlib=js-3.8.0&auto=format&s=a8e78c350885887343414a032248dc84 not downloaded yet
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3635%252F7883635%252F7883635-docs_service_history-modified-1774607581854.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a11fe661fca35c35a452e2262655f20%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607581854.jpeg?ixlib=js-3.8.0&auto=format&s=4a11fe661fca35c35a452e2262655f20 not downloaded yet
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1222/20341222/docs_service_history-1774701325400.jpg?ixlib=js-3.8.0&auto=format&s=b44301b621438367d2575ed8265471de> (referer: None)
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb3050>
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1222%252F20341222%252Fdocs_service_history-1774701325400.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db44301b621438367d2575ed8265471de') HTTP/1.1" 204 0
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1222/20341222/docs_service_history-1774701325400.jpg?ixlib=js-3.8.0&auto=format&s=b44301b621438367d2575ed8265471de saved to cache
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607595074.jpeg?ixlib=js-3.8.0&auto=format&s=a8e78c350885887343414a032248dc84> (referer: None)
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607581854.jpeg?ixlib=js-3.8.0&auto=format&s=4a11fe661fca35c35a452e2262655f20> (referer: None)
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb816d0>
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3635%252F7883635%252F7883635-docs_service_history-modified-1774607595074.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da8e78c350885887343414a032248dc84') HTTP/1.1" 204 0
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607595074.jpeg?ixlib=js-3.8.0&auto=format&s=a8e78c350885887343414a032248dc84 saved to cache
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb28d0>
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3635%252F7883635%252F7883635-docs_service_history-modified-1774607581854.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a11fe661fca35c35a452e2262655f20') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607581854.jpeg?ixlib=js-3.8.0&auto=format&s=4a11fe661fca35c35a452e2262655f20 saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3635/7883635/interior_boot-1774604895495.jpeg> (referer: None)
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$\xba\xb0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02}\x00\x00$\xaf\xe6\x00\x00\x00\x00'
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce14990>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3635%252F7883635%252Finterior_boot-1774604895495.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3635/7883635/interior_boot-1774604895495.jpeg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3635/7883635/interior_dashboard-1774605156168.jpeg> (referer: None)
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1c\xa2r\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xc3S\x00\x1c\x97\xf2\x00\x00\x00\x00'
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1a47d0>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252Finterior_dashboard-1774605156168.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/interior_dashboard-1774605156168.jpeg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3635/7883635/interior_rear_seats-1774605044125.jpeg> (referer: None)
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19669988.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00 \xf5"\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x8fn\x00 \xea\xa0\x00\x00\x00\x00'
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d329a90>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3635%252F7883635%252Finterior_rear_seats-1774605044125.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3635/7883635/interior_rear_seats-1774605044125.jpeg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3635/7883635/7883635-exterior_rear_passenger-default-1774608101996.jpeg> (referer: None)
2026-03-29 20:21:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51863a9c-e73f-5d98-a212-37f91448d6a6 with identifier: 19669988
2026-03-29 20:21:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51863a9c-e73f-5d98-a212-37f91448d6a6 with scrape type 1
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_front_driver-1774705418113.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_driver-1774705418113.jpeg not downloaded yet
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_rear_driver-1774705445706.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_driver-1774705445706.jpeg not downloaded yet
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_front_passenger-1774705430991.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_passenger-1774705430991.jpeg not downloaded yet
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_rear_passenger-1774708963718.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_passenger-1774708963718.jpeg not downloaded yet
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9988%252F19669988%252Finterior_front_seats-1774709282231.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg not downloaded yet
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9988%252F19669988%252F19669988-interior_rear_seats-modified-1774711955094.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9988/19669988/19669988-interior_rear_seats-modified-1774711955094.jpeg not downloaded yet
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edcca10>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252F7883635-exterior_rear_passenger-default-1774608101996.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/7883635-exterior_rear_passenger-default-1774608101996.jpeg saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Finterior_dashboard-1774709371735.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/interior_dashboard-1774709371735.jpeg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Finstrument_cluster-1774709419948.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/instrument_cluster-1774709419948.jpeg not downloaded yet
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3635/7883635/7883635-exterior_front_passenger-modified-1774607200596.jpeg> (referer: None)
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9988%252F19669988%252Finterior_boot-1774709401346.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9988/19669988/interior_boot-1774709401346.jpeg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9988%252F19669988%252F19669988-docs_service_history-modified-1774717122515.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D73f7df32568aa564199ba3a6477c67b1%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9988/19669988/19669988-docs_service_history-modified-1774717122515.jpeg?ixlib=js-3.8.0&auto=format&s=73f7df32568aa564199ba3a6477c67b1 not downloaded yet
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3635/7883635/interior_front_seats-1774605424619.jpeg> (referer: None)
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca70a90>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3635%252F7883635%252F7883635-exterior_front_passenger-modified-1774607200596.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3635/7883635/7883635-exterior_front_passenger-modified-1774607200596.jpeg saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xe8\xa0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03[\x0e\x00*\xde\x1e\x00\x00\x00\x00'
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd9490>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3635%252F7883635%252Finterior_front_seats-1774605424619.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3635/7883635/interior_front_seats-1774605424619.jpeg saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471501.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9988/19669988/19669988-docs_service_history-modified-1774717122515.jpeg?ixlib=js-3.8.0&auto=format&s=73f7df32568aa564199ba3a6477c67b1> (referer: None)
2026-03-29 20:21:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0bd02df-03cc-5587-9108-1a1c91bf1206 with identifier: 20471501
2026-03-29 20:21:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bd02df-03cc-5587-9108-1a1c91bf1206 with scrape type 1
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_front_driver-1774699740808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_driver-1774699740808.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_rear_driver-1774699789885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_driver-1774699789885.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_front_passenger-1774699815361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_passenger-1774699815361.jpg not downloaded yet
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca73250>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9988%252F19669988%252F19669988-docs_service_history-modified-1774717122515.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D73f7df32568aa564199ba3a6477c67b1') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9988/19669988/19669988-docs_service_history-modified-1774717122515.jpeg?ixlib=js-3.8.0&auto=format&s=73f7df32568aa564199ba3a6477c67b1 saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_rear_passenger-1774699798803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_passenger-1774699798803.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1501%252F20471501%252Finterior_front_seats-1774700260314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1501/20471501/interior_front_seats-1774700260314.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1501%252F20471501%252Finterior_rear_seats-1774700111801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1501/20471501/interior_rear_seats-1774700111801.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1501%252F20471501%252Finterior_dashboard-1774703454633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1501/20471501/interior_dashboard-1774703454633.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Finstrument_cluster-1774700178294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/instrument_cluster-1774700178294.jpg not downloaded yet
2026-03-29 20:21:18 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14232272) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/9988/19669988/interior_dashboard-1774709371735.jpeg>.
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1501%252F20471501%252Finterior_boot-1774700189522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1501/20471501/interior_boot-1774700189522.jpg not downloaded yet
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1501%252F20471501%252Fdocs_service_history-1774703494612.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D40a3399f0eec550565e7ad2f3252ccb7%27 HTTP/1.1" 200 None
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1501/20471501/docs_service_history-1774703494612.jpg?ixlib=js-3.8.0&auto=format&s=40a3399f0eec550565e7ad2f3252ccb7 not downloaded yet
2026-03-29 20:21:18 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16340322) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9988/19669988/interior_boot-1774709401346.jpeg>.
2026-03-29 20:21:19 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9988/19669988/interior_boot-1774709401346.jpeg>.
2026-03-29 20:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9988/19669988/interior_boot-1774709401346.jpeg> (referer: None)
2026-03-29 20:21:19 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/9988/19669988/interior_dashboard-1774709371735.jpeg>.
2026-03-29 20:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9988/19669988/instrument_cluster-1774709419948.jpeg> (referer: None)
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xef&\xf2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n.p\x00\xef\x1cr\x00\x00\x00\x00'
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cec1a10>
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9988%252F19669988%252Finterior_boot-1774709401346.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9988/19669988/interior_boot-1774709401346.jpeg saved to cache
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x91Q\x89\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xe3\x08\x00\x91G\t\x00\x00\x00\x00'
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cec0f90>
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Finstrument_cluster-1774709419948.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/instrument_cluster-1774709419948.jpeg saved to cache
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9988/19669988/interior_dashboard-1774709371735.jpeg> (referer: None)
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xce\xa8\x90\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\x82@\x00\xce\x9e\x10\x00\x00\x00\x00'
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d058ad0>
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Finterior_dashboard-1774709371735.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/interior_dashboard-1774709371735.jpeg saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1501/20471501/docs_service_history-1774703494612.jpg?ixlib=js-3.8.0&auto=format&s=40a3399f0eec550565e7ad2f3252ccb7> (referer: None)
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1501/20471501/interior_boot-1774700189522.jpg> (referer: None)
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d032c10>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1501%252F20471501%252Fdocs_service_history-1774703494612.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D40a3399f0eec550565e7ad2f3252ccb7') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1501/20471501/docs_service_history-1774703494612.jpg?ixlib=js-3.8.0&auto=format&s=40a3399f0eec550565e7ad2f3252ccb7 saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d032110>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1501%252F20471501%252Finterior_boot-1774700189522.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1501/20471501/interior_boot-1774700189522.jpg saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1501/20471501/interior_dashboard-1774703454633.jpg> (referer: None)
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1501/20471501/interior_rear_seats-1774700111801.jpg> (referer: None)
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cec1510>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1501%252F20471501%252Finterior_dashboard-1774703454633.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1501/20471501/interior_dashboard-1774703454633.jpg saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12127571.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b7950>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1501%252F20471501%252Finterior_rear_seats-1774700111801.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1501/20471501/interior_rear_seats-1774700111801.jpg saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4829c7da-f4d9-539f-9083-72c89aa58e86 with identifier: 12127571
2026-03-29 20:21:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4829c7da-f4d9-539f-9083-72c89aa58e86 with scrape type 1
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_front_driver-1774710735717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_driver-1774710735717.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_rear_driver-1774710752197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_driver-1774710752197.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_front_passenger-1774710779510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_passenger-1774710779510.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_rear_passenger-1774710764275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_passenger-1774710764275.jpg not downloaded yet
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1501/20471501/instrument_cluster-1774700178294.jpg> (referer: None)
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7571%252F12127571%252Finterior_front_seats-1774711353533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7571/12127571/interior_front_seats-1774711353533.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7571%252F12127571%252Finterior_rear_seats-1774711395237.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7571/12127571/interior_rear_seats-1774711395237.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Finterior_dashboard-1774711441905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/interior_dashboard-1774711441905.jpg not downloaded yet
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483047.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Finstrument_cluster-1774711432314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/instrument_cluster-1774711432314.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7571%252F12127571%252Finterior_boot-1774711476685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7571/12127571/interior_boot-1774711476685.jpg not downloaded yet
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_passenger-1774699798803.jpg> (referer: None)
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7571%252F12127571%252Fdocs_service_history-1774711697712.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db2e4c941d7477a62dab372445605e3d4%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7571/12127571/docs_service_history-1774711697712.jpg?ixlib=js-3.8.0&auto=format&s=b2e4c941d7477a62dab372445605e3d4 not downloaded yet
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac9210>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Finstrument_cluster-1774700178294.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/instrument_cluster-1774700178294.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4495522e-2a71-510a-99aa-e26a7ffa442d with identifier: 20483047
2026-03-29 20:21:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4495522e-2a71-510a-99aa-e26a7ffa442d with scrape type 1
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3047%252F20483047%252Fexterior_front_driver-1774701754584.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3047/20483047/exterior_front_driver-1774701754584.jpg not downloaded yet
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd9910>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_rear_passenger-1774699798803.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_passenger-1774699798803.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Fexterior_rear_driver-1774702813404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_driver-1774702813404.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Fexterior_front_passenger-1774702823790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/exterior_front_passenger-1774702823790.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Fexterior_rear_passenger-1774702835496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_passenger-1774702835496.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20483047%252Finterior_front_seats-1774702096503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20483047/interior_front_seats-1774702096503.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20483047%252Finterior_rear_seats-1774702111078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20483047/interior_rear_seats-1774702111078.jpg not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Finterior_dashboard-1774702866118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/interior_dashboard-1774702866118.jpg not downloaded yet
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_passenger-1774699815361.jpg> (referer: None)
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Finterior_boot-1774702878019.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/interior_boot-1774702878019.jpg not downloaded yet
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1501/20471501/interior_front_seats-1774700260314.jpg> (referer: None)
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3047%252F20483047%252Fdocs_service_history-1774702785059.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29ec9c7bb64b4adafcb1eb934116c1f0%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20483047/docs_service_history-1774702785059.png?ixlib=js-3.8.0&auto=format&s=29ec9c7bb64b4adafcb1eb934116c1f0 not downloaded yet
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20483047%252Fdamage_dents-1774701863782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20483047/damage_dents-1774701863782.jpg not downloaded yet
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_passenger-1774710764275.jpg> (referer: None)
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7571/12127571/instrument_cluster-1774711432314.jpg> (referer: None)
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7571/12127571/interior_rear_seats-1774711395237.jpg> (referer: None)
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce25a50>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_front_passenger-1774699815361.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_passenger-1774699815361.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea84110>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1501%252F20471501%252Finterior_front_seats-1774700260314.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1501/20471501/interior_front_seats-1774700260314.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc16689c50>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_rear_passenger-1774710764275.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_passenger-1774710764275.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c26f210>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Finstrument_cluster-1774711432314.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/instrument_cluster-1774711432314.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed62410>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7571%252F12127571%252Finterior_rear_seats-1774711395237.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7571/12127571/interior_rear_seats-1774711395237.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3047/20483047/interior_dashboard-1774702866118.jpg> (referer: None)
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3047/20483047/interior_rear_seats-1774702111078.jpg> (referer: None)
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c216f50>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Finterior_dashboard-1774702866118.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/interior_dashboard-1774702866118.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20483047/docs_service_history-1774702785059.png?ixlib=js-3.8.0&auto=format&s=29ec9c7bb64b4adafcb1eb934116c1f0> (referer: None)
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebec050>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20483047%252Finterior_rear_seats-1774702111078.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20483047/interior_rear_seats-1774702111078.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:21:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 65445
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba4f10>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_8.png HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3047%252F20483047%252Fdocs_service_history-1774702785059.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29ec9c7bb64b4adafcb1eb934116c1f0') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20483047/docs_service_history-1774702785059.png?ixlib=js-3.8.0&auto=format&s=29ec9c7bb64b4adafcb1eb934116c1f0 saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3047/20483047/interior_boot-1774702878019.jpg> (referer: None)
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3047/20483047/damage_dents-1774701863782.jpg> (referer: None)
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_passenger-1774702835496.jpg> (referer: None)
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_driver-1774702813404.jpg> (referer: None)
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23e810>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Finterior_boot-1774702878019.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/interior_boot-1774702878019.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba49d0>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20483047%252Fdamage_dents-1774701863782.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20483047/damage_dents-1774701863782.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7bbb50>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Fexterior_rear_passenger-1774702835496.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_passenger-1774702835496.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec17990>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20483047%252Fexterior_rear_driver-1774702813404.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_driver-1774702813404.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3047/20483047/interior_front_seats-1774702096503.jpg> (referer: None)
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9e490>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20483047%252Finterior_front_seats-1774702096503.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20483047/interior_front_seats-1774702096503.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7571/12127571/docs_service_history-1774711697712.jpg?ixlib=js-3.8.0&auto=format&s=b2e4c941d7477a62dab372445605e3d4> (referer: None)
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3047/20483047/exterior_front_driver-1774701754584.jpg> (referer: None)
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7571/12127571/interior_boot-1774711476685.jpg> (referer: None)
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7571/12127571/interior_dashboard-1774711441905.jpg> (referer: None)
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 4495522e-2a71-510a-99aa-e26a7ffa442d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07e950>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7571%252F12127571%252Fdocs_service_history-1774711697712.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db2e4c941d7477a62dab372445605e3d4') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7571/12127571/docs_service_history-1774711697712.jpg?ixlib=js-3.8.0&auto=format&s=b2e4c941d7477a62dab372445605e3d4 saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce66610>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3047%252F20483047%252Fexterior_front_driver-1774701754584.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3047/20483047/exterior_front_driver-1774701754584.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4495522e-2a71-510a-99aa-e26a7ffa442d
2026-03-29 20:21:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4495522e-2a71-510a-99aa-e26a7ffa442d, skipping ID generation
2026-03-29 20:21:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4495522e-2a71-510a-99aa-e26a7ffa442d with scrape type 1
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4495522e-2a71-510a-99aa-e26a7ffa442d sending to next pipeline
2026-03-29 20:21:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4495522e-2a71-510a-99aa-e26a7ffa442d, identifier: 20483047
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9f890>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7571%252F12127571%252Finterior_boot-1774711476685.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7571/12127571/interior_boot-1774711476685.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea84710>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Finterior_dashboard-1774711441905.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/interior_dashboard-1774711441905.jpg saved to cache
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4495522e-2a71-510a-99aa-e26a7ffa442d with identifier: 20483047
2026-03-29 20:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4495522e-2a71-510a-99aa-e26a7ffa442d with identifier: 20483047
2026-03-29 20:21:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4495522e-2a71-510a-99aa-e26a7ffa442d with identifier: 20483047 to the API
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3047/20483047/exterior_front_driver-1774701754584.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4495522e-2a71-510a-99aa-e26a7ffa442d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BV21 SNJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20483047',
'listing': 'auction',
'location': 'Darlington Darlington',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 63000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1914455,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3047/20483047/exterior_front_driver-1774701754584.jpg',
'Width': 3514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2565105,
'Height': 2659,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_driver-1774702813404.jpg',
'Width': 3545},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465254,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3047/20483047/exterior_rear_passenger-1774702835496.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4490977,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3047/20483047/interior_front_seats-1774702096503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3572023,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3047/20483047/interior_rear_seats-1774702111078.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2162741,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3047/20483047/interior_dashboard-1774702866118.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1726297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3047/20483047/interior_boot-1774702878019.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 87289,
'Height': 703,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20483047/docs_service_history-1774702785059.png?ixlib=js-3.8.0&auto=format&s=29ec9c7bb64b4adafcb1eb934116c1f0',
'Width': 1725},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4495522e-2a71-510a-99aa-e26a7ffa442d/4495522e-2a71-510a-99aa-e26a7ffa442d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3820549,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3047/20483047/damage_dents-1774701863782.jpg',
'Width': 4032}],
'price': 18886,
'price_includes_vat': False,
'registration_date': '2021-04-13',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE R-DYNAM SE D MHEV AWD A',
'transmission': 'automatic',
'trim': 'R-DYNAM SE D MHEV AWD A',
'vin': 'SADCA2AN8MA668732',
'year': 2021}
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483047%27 HTTP/1.1" 200 None
2026-03-29 20:21:25 [motorway.uk] INFO: Saving data for 20483047: {'created_time': 1774815685.463131, 'last_price_update_time': 1774815685.463141, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20483047') HTTP/1.1" 204 0
2026-03-29 20:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_passenger-1774710779510.jpg> (referer: None)
2026-03-29 20:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_driver-1774710752197.jpg> (referer: None)
2026-03-29 20:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7571/12127571/interior_front_seats-1774711353533.jpg> (referer: None)
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23d2d0>
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_front_passenger-1774710779510.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_passenger-1774710779510.jpg saved to cache
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9f390>
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_rear_driver-1774710752197.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_driver-1774710752197.jpg saved to cache
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d043550>
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7571%252F12127571%252Finterior_front_seats-1774711353533.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7571/12127571/interior_front_seats-1774711353533.jpg saved to cache
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_driver-1774699740808.jpg> (referer: None)
2026-03-29 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_driver-1774710735717.jpg> (referer: None)
2026-03-29 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_driver-1774699789885.jpg> (referer: None)
2026-03-29 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9988/19669988/19669988-interior_rear_seats-modified-1774711955094.jpeg> (referer: None)
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec15810>
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_front_driver-1774699740808.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_driver-1774699740808.jpg saved to cache
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5454d0>
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7571%252F12127571%252Fexterior_front_driver-1774710735717.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_driver-1774710735717.jpg saved to cache
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4829c7da-f4d9-539f-9083-72c89aa58e86
2026-03-29 20:21:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4829c7da-f4d9-539f-9083-72c89aa58e86, skipping ID generation
2026-03-29 20:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4829c7da-f4d9-539f-9083-72c89aa58e86 with scrape type 1
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4829c7da-f4d9-539f-9083-72c89aa58e86 sending to next pipeline
2026-03-29 20:21:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4829c7da-f4d9-539f-9083-72c89aa58e86, identifier: 12127571
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14bcf390>
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1501%252F20471501%252Fexterior_rear_driver-1774699789885.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_driver-1774699789885.jpg saved to cache
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0bd02df-03cc-5587-9108-1a1c91bf1206
2026-03-29 20:21:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0bd02df-03cc-5587-9108-1a1c91bf1206, skipping ID generation
2026-03-29 20:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0bd02df-03cc-5587-9108-1a1c91bf1206 with scrape type 1
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0bd02df-03cc-5587-9108-1a1c91bf1206 sending to next pipeline
2026-03-29 20:21:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c0bd02df-03cc-5587-9108-1a1c91bf1206, identifier: 20471501
2026-03-29 20:21:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4829c7da-f4d9-539f-9083-72c89aa58e86 with identifier: 12127571
2026-03-29 20:21:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4829c7da-f4d9-539f-9083-72c89aa58e86 with identifier: 12127571
2026-03-29 20:21:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4829c7da-f4d9-539f-9083-72c89aa58e86 with identifier: 12127571 to the API
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_driver-1774710735717.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4829c7da-f4d9-539f-9083-72c89aa58e86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YJ19 EBY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12127571',
'listing': 'auction',
'location': 'Cheshire East Congleton',
'make': 'BMW',
'model': '4 Series',
'odometer': 25268,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2384345,
'Height': 2590,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_driver-1774710735717.jpg',
'Width': 3453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1822584,
'Height': 2234,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_driver-1774710752197.jpg',
'Width': 2978},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478457,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_front_passenger-1774710779510.jpg',
'Width': 3211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1943425,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7571/12127571/exterior_rear_passenger-1774710764275.jpg',
'Width': 3642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5052362,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7571/12127571/interior_front_seats-1774711353533.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4647900,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7571/12127571/interior_rear_seats-1774711395237.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1935410,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7571/12127571/interior_dashboard-1774711441905.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3992634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7571/12127571/instrument_cluster-1774711432314.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5630588,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7571/12127571/interior_boot-1774711476685.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4829c7da-f4d9-539f-9083-72c89aa58e86/4829c7da-f4d9-539f-9083-72c89aa58e86_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1174768,
'Height': 942,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7571/12127571/docs_service_history-1774711697712.jpg?ixlib=js-3.8.0&auto=format&s=b2e4c941d7477a62dab372445605e3d4',
'Width': 2255}],
'price': 23729,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW 440I M Sport Auto',
'transmission': 'automatic',
'trim': '440I M Sport Auto',
'vin': 'WBA4W72080AF39403',
'year': 2019}
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712127571%27 HTTP/1.1" 200 None
2026-03-29 20:21:26 [motorway.uk] INFO: Saving data for 12127571: {'created_time': 1774815686.959403, 'last_price_update_time': 1774815686.959415, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12127571') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c0bd02df-03cc-5587-9108-1a1c91bf1206 with identifier: 20471501
2026-03-29 20:21:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c0bd02df-03cc-5587-9108-1a1c91bf1206 with identifier: 20471501
2026-03-29 20:21:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c0bd02df-03cc-5587-9108-1a1c91bf1206 with identifier: 20471501 to the API
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_driver-1774699789885.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c0bd02df-03cc-5587-9108-1a1c91bf1206',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA19 FPP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471501',
'listing': 'auction',
'location': 'Northamptonshire Daventry',
'make': 'Ford',
'model': 'Ecosport',
'odometer': 26000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1023761,
'Height': 2560,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_driver-1774699740808.jpg',
'Width': 3413},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1130848,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_driver-1774699789885.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1011604,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_front_passenger-1774699815361.jpg',
'Width': 3307},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1007921,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1501/20471501/exterior_rear_passenger-1774699798803.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2629860,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1501/20471501/interior_front_seats-1774700260314.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2689289,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1501/20471501/interior_rear_seats-1774700111801.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2093590,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1501/20471501/interior_dashboard-1774703454633.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2380181,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1501/20471501/instrument_cluster-1774700178294.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2191603,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1501/20471501/interior_boot-1774700189522.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0bd02df-03cc-5587-9108-1a1c91bf1206/c0bd02df-03cc-5587-9108-1a1c91bf1206_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1031804,
'Height': 3130,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1501/20471501/docs_service_history-1774703494612.jpg?ixlib=js-3.8.0&auto=format&s=40a3399f0eec550565e7ad2f3252ccb7',
'Width': 2348}],
'price': 8566,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ecosport ST-LINE',
'transmission': 'manual',
'trim': 'ST-LINE',
'vin': 'WF01XXERK1KL32244',
'year': 2019}
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471501%27 HTTP/1.1" 200 None
2026-03-29 20:21:27 [motorway.uk] INFO: Saving data for 20471501: {'created_time': 1774815687.360922, 'last_price_update_time': 1774815687.360934, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471501') HTTP/1.1" 204 0
2026-03-29 20:21:27 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14406612) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg>.
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd7690>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9988%252F19669988%252F19669988-interior_rear_seats-modified-1774711955094.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9988/19669988/19669988-interior_rear_seats-modified-1774711955094.jpeg saved to cache
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_driver-1774705445706.jpeg> (referer: None)
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_passenger-1774705430991.jpeg> (referer: None)
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_passenger-1774708963718.jpeg> (referer: None)
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16823030.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:27 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg>.
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca99690>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_rear_driver-1774705445706.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_driver-1774705445706.jpeg saved to cache
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_rear_driver-1774604261175.jpeg> (referer: None)
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce66250>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_front_passenger-1774705430991.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_passenger-1774705430991.jpeg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea87c90>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_rear_passenger-1774708963718.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_passenger-1774708963718.jpeg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5a24f15-5cd9-5522-97f9-e7360c025278 with identifier: 16823030
2026-03-29 20:21:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a24f15-5cd9-5522-97f9-e7360c025278 with scrape type 1
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_front_driver-1774704408276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_driver-1774704408276.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_rear_driver-1774704426632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_driver-1774704426632.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_front_passenger-1774704452425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_passenger-1774704452425.jpg not downloaded yet
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c216fd0>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252Fexterior_rear_driver-1774604261175.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_rear_driver-1774604261175.jpeg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_rear_passenger-1774704445658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_passenger-1774704445658.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3030%252F16823030%252Finterior_front_seats-1774705246167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3030/16823030/interior_front_seats-1774705246167.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3030%252F16823030%252Finterior_rear_seats-1774705250287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3030/16823030/interior_rear_seats-1774705250287.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Finterior_dashboard-1774705299650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/interior_dashboard-1774705299650.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3030%252F16823030%252Finterior_boot-1774705286247.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3030/16823030/interior_boot-1774705286247.jpg not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3030%252F16823030%252Fdocs_service_history-1774707193693.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da0f0a15a57095a0e2d4f1f5d5942c970%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707193693.jpg?ixlib=js-3.8.0&auto=format&s=a0f0a15a57095a0e2d4f1f5d5942c970 not downloaded yet
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3030%252F16823030%252Fdocs_service_history-1774707194600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9fb31d7d85391e863911d1f5edd4affb%27 HTTP/1.1" 200 None
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707194600.jpg?ixlib=js-3.8.0&auto=format&s=9fb31d7d85391e863911d1f5edd4affb not downloaded yet
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_driver-1774704408276.jpg> (referer: None)
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_front_driver-1774603849197.jpeg> (referer: None)
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_driver-1774705418113.jpeg> (referer: None)
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg> (referer: None)
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1222/20341222/instrument_cluster-1774701304058.jpg> (referer: None)
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e072250>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_front_driver-1774704408276.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_driver-1774704408276.jpg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071ad0>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3635%252F7883635%252Fexterior_front_driver-1774603849197.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_front_driver-1774603849197.jpeg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a637bcd-a141-50f1-b025-2d8408f40a57
2026-03-29 20:21:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a637bcd-a141-50f1-b025-2d8408f40a57, skipping ID generation
2026-03-29 20:21:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a637bcd-a141-50f1-b025-2d8408f40a57 with scrape type 1
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a637bcd-a141-50f1-b025-2d8408f40a57 sending to next pipeline
2026-03-29 20:21:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4a637bcd-a141-50f1-b025-2d8408f40a57, identifier: 7883635
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacba90>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9988%252F19669988%252Fexterior_front_driver-1774705418113.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_driver-1774705418113.jpeg saved to cache
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:29 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:29 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:29 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xd6\xc9q\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\nc\x00\xd6\xbe\xf1\x00\x00\x00\x00'
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba8a90>
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9988%252F19669988%252Finterior_front_seats-1774709282231.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg saved to cache
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51863a9c-e73f-5d98-a212-37f91448d6a6
2026-03-29 20:21:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51863a9c-e73f-5d98-a212-37f91448d6a6, skipping ID generation
2026-03-29 20:21:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51863a9c-e73f-5d98-a212-37f91448d6a6 with scrape type 1
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51863a9c-e73f-5d98-a212-37f91448d6a6 sending to next pipeline
2026-03-29 20:21:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 51863a9c-e73f-5d98-a212-37f91448d6a6, identifier: 19669988
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28d110>
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Finstrument_cluster-1774701304058.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/instrument_cluster-1774701304058.jpg saved to cache
2026-03-29 20:21:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4a637bcd-a141-50f1-b025-2d8408f40a57 with identifier: 7883635
2026-03-29 20:21:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4a637bcd-a141-50f1-b025-2d8408f40a57 with identifier: 7883635
2026-03-29 20:21:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4a637bcd-a141-50f1-b025-2d8408f40a57 with identifier: 7883635 to the API
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_front_driver-1774603849197.jpeg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4a637bcd-a141-50f1-b025-2d8408f40a57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HJ16 XOP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7883635',
'listing': 'auction',
'location': 'Hampshire Andover',
'make': 'DS',
'model': 'DS3',
'odometer': 26875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1952720,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_front_driver-1774603849197.jpeg',
'Width': 3571},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 917574,
'Height': 2139,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3635/7883635/exterior_rear_driver-1774604261175.jpeg',
'Width': 2852},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424078,
'Height': 1085,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3635/7883635/7883635-exterior_front_passenger-modified-1774607200596.jpeg',
'Width': 1447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468238,
'Height': 1266,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3635/7883635/7883635-exterior_rear_passenger-default-1774608101996.jpeg',
'Width': 1688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3031982,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3635/7883635/interior_front_seats-1774605424619.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2458768,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3635/7883635/interior_rear_seats-1774605044125.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2057669,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3635/7883635/interior_dashboard-1774605156168.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2570160,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3635/7883635/interior_boot-1774604895495.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1395274,
'Height': 1994,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607595074.jpeg?ixlib=js-3.8.0&auto=format&s=a8e78c350885887343414a032248dc84',
'Width': 2659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a637bcd-a141-50f1-b025-2d8408f40a57/4a637bcd-a141-50f1-b025-2d8408f40a57_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1496012,
'Height': 2075,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3635/7883635/7883635-docs_service_history-modified-1774607581854.jpeg?ixlib=js-3.8.0&auto=format&s=4a11fe661fca35c35a452e2262655f20',
'Width': 2767}],
'price': 3744,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seats_number': None,
'seller_name': None,
'title': 'DS DS3 Chic PureTech',
'transmission': 'manual',
'trim': 'Chic PureTech',
'vin': 'VF7SAHMZ6GW582408',
'year': 2016}
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277883635%27 HTTP/1.1" 200 None
2026-03-29 20:21:30 [motorway.uk] INFO: Saving data for 7883635: {'created_time': 1774815690.000923, 'last_price_update_time': 1774815690.000935, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7883635') HTTP/1.1" 204 0
2026-03-29 20:21:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 51863a9c-e73f-5d98-a212-37f91448d6a6 with identifier: 19669988
2026-03-29 20:21:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 51863a9c-e73f-5d98-a212-37f91448d6a6 with identifier: 19669988
2026-03-29 20:21:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 51863a9c-e73f-5d98-a212-37f91448d6a6 with identifier: 19669988 to the API
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '51863a9c-e73f-5d98-a212-37f91448d6a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WJ21 LUR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19669988',
'listing': 'auction',
'location': 'Kent Tonbridge',
'make': 'Kia',
'model': 'Niro',
'odometer': 65950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4410682,
'Height': 3995,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_driver-1774705418113.jpeg',
'Width': 5326},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4131088,
'Height': 4261,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_driver-1774705445706.jpeg',
'Width': 5681},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4925521,
'Height': 4195,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_front_passenger-1774705430991.jpeg',
'Width': 5593},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3804940,
'Height': 4640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9988/19669988/exterior_rear_passenger-1774708963718.jpeg',
'Width': 6186},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14406612,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9988/19669988/interior_front_seats-1774709282231.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7804253,
'Height': 4733,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9988/19669988/19669988-interior_rear_seats-modified-1774711955094.jpeg',
'Width': 6311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14232272,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9988/19669988/interior_dashboard-1774709371735.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 9843857,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9988/19669988/instrument_cluster-1774709419948.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16340322,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9988/19669988/interior_boot-1774709401346.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51863a9c-e73f-5d98-a212-37f91448d6a6/51863a9c-e73f-5d98-a212-37f91448d6a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2792309,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9988/19669988/19669988-docs_service_history-modified-1774717122515.jpeg?ixlib=js-3.8.0&auto=format&s=73f7df32568aa564199ba3a6477c67b1',
'Width': 3024}],
'price': 10532,
'price_includes_vat': False,
'registration_date': '2021-04-09',
'seats_number': None,
'seller_name': None,
'title': 'Kia Niro 2 HEV S-A',
'transmission': 'automatic',
'trim': '2 HEV S-A',
'vin': 'KNACC81CVM5449697',
'year': 2021}
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719669988%27 HTTP/1.1" 200 None
2026-03-29 20:21:30 [motorway.uk] INFO: Saving data for 19669988: {'created_time': 1774815690.399796, 'last_price_update_time': 1774815690.399807, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19669988') HTTP/1.1" 204 0
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1222/20341222/interior_boot-1774711582262.jpg> (referer: None)
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707194600.jpg?ixlib=js-3.8.0&auto=format&s=9fb31d7d85391e863911d1f5edd4affb> (referer: None)
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707193693.jpg?ixlib=js-3.8.0&auto=format&s=a0f0a15a57095a0e2d4f1f5d5942c970> (referer: None)
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc4cd0>
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1222%252F20341222%252Finterior_boot-1774711582262.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1222/20341222/interior_boot-1774711582262.jpg saved to cache
2026-03-29 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d232a90>
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3030%252F16823030%252Fdocs_service_history-1774707194600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9fb31d7d85391e863911d1f5edd4affb') HTTP/1.1" 204 0
2026-03-29 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707194600.jpg?ixlib=js-3.8.0&auto=format&s=9fb31d7d85391e863911d1f5edd4affb saved to cache
2026-03-29 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d230650>
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3030%252F16823030%252Fdocs_service_history-1774707193693.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da0f0a15a57095a0e2d4f1f5d5942c970') HTTP/1.1" 204 0
2026-03-29 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707193693.jpg?ixlib=js-3.8.0&auto=format&s=a0f0a15a57095a0e2d4f1f5d5942c970 saved to cache
2026-03-29 20:21:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_passenger-1774704445658.jpg> (referer: None)
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3030/16823030/interior_rear_seats-1774705250287.jpg> (referer: None)
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3030/16823030/interior_front_seats-1774705246167.jpg> (referer: None)
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3030/16823030/interior_boot-1774705286247.jpg> (referer: None)
2026-03-29 20:21:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3030/16823030/interior_dashboard-1774705299650.jpg> (referer: None)
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e064c90>
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_rear_passenger-1774704445658.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_passenger-1774704445658.jpg saved to cache
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0303d0>
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3030%252F16823030%252Finterior_rear_seats-1774705250287.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3030/16823030/interior_rear_seats-1774705250287.jpg saved to cache
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7ea010>
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3030%252F16823030%252Finterior_front_seats-1774705246167.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3030/16823030/interior_front_seats-1774705246167.jpg saved to cache
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e985ad0>
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3030%252F16823030%252Finterior_boot-1774705286247.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3030/16823030/interior_boot-1774705286247.jpg saved to cache
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edcf510>
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Finterior_dashboard-1774705299650.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/interior_dashboard-1774705299650.jpg saved to cache
2026-03-29 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_driver-1774704426632.jpg> (referer: None)
2026-03-29 20:21:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_passenger-1774704452425.jpg> (referer: None)
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e9690>
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_rear_driver-1774704426632.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_driver-1774704426632.jpg saved to cache
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd8a10>
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3030%252F16823030%252Fexterior_front_passenger-1774704452425.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_passenger-1774704452425.jpg saved to cache
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5a24f15-5cd9-5522-97f9-e7360c025278
2026-03-29 20:21:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5a24f15-5cd9-5522-97f9-e7360c025278, skipping ID generation
2026-03-29 20:21:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a24f15-5cd9-5522-97f9-e7360c025278 with scrape type 1
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5a24f15-5cd9-5522-97f9-e7360c025278 sending to next pipeline
2026-03-29 20:21:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d5a24f15-5cd9-5522-97f9-e7360c025278, identifier: 16823030
2026-03-29 20:21:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d5a24f15-5cd9-5522-97f9-e7360c025278 with identifier: 16823030
2026-03-29 20:21:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d5a24f15-5cd9-5522-97f9-e7360c025278 with identifier: 16823030
2026-03-29 20:21:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d5a24f15-5cd9-5522-97f9-e7360c025278 with identifier: 16823030 to the API
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_passenger-1774704452425.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd5a24f15-5cd9-5522-97f9-e7360c025278',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'HG72 KPV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16823030',
'listing': 'auction',
'location': 'Dorset Christchurch',
'make': 'Ford',
'model': 'Ranger',
'odometer': 65893,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1507410,
'Height': 2807,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_driver-1774704408276.jpg',
'Width': 3742},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1388326,
'Height': 2768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_driver-1774704426632.jpg',
'Width': 3691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1828781,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_front_passenger-1774704452425.jpg',
'Width': 3671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1869442,
'Height': 2676,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3030/16823030/exterior_rear_passenger-1774704445658.jpg',
'Width': 3568},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3684358,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3030/16823030/interior_front_seats-1774705246167.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3398191,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3030/16823030/interior_rear_seats-1774705250287.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3685917,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3030/16823030/interior_dashboard-1774705299650.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4076512,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3030/16823030/interior_boot-1774705286247.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3414262,
'Height': 3069,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707193693.jpg?ixlib=js-3.8.0&auto=format&s=a0f0a15a57095a0e2d4f1f5d5942c970',
'Width': 2112},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a24f15-5cd9-5522-97f9-e7360c025278/d5a24f15-5cd9-5522-97f9-e7360c025278_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442306,
'Height': 2637,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3030/16823030/docs_service_history-1774707194600.jpg?ixlib=js-3.8.0&auto=format&s=9fb31d7d85391e863911d1f5edd4affb',
'Width': 1823}],
'price': 12935,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Wildtrak Ecoblue 4X4 A',
'transmission': 'automatic',
'trim': 'Wildtrak Ecoblue 4X4 A',
'vin': '6FPPXXMJ2PNU23300',
'year': 2022}
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716823030%27 HTTP/1.1" 200 None
2026-03-29 20:21:33 [motorway.uk] INFO: Saving data for 16823030: {'created_time': 1774815693.089948, 'last_price_update_time': 1774815693.089959, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16823030') HTTP/1.1" 204 0
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_passenger-1774700864469.jpg> (referer: None)
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1222/20341222/interior_front_seats-1774711548127.jpg> (referer: None)
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1222/20341222/interior_rear_seats-1774701270659.jpg> (referer: None)
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_passenger-1774700868980.jpg> (referer: None)
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1222/20341222/interior_dashboard-1774711566190.jpg> (referer: None)
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_driver-1774700865959.jpg> (referer: None)
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2db590>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_rear_passenger-1774700864469.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_passenger-1774700864469.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d777ed0>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1222%252F20341222%252Finterior_front_seats-1774711548127.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1222/20341222/interior_front_seats-1774711548127.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce50a10>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1222%252F20341222%252Finterior_rear_seats-1774701270659.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1222/20341222/interior_rear_seats-1774701270659.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11c050>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_front_passenger-1774700868980.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_passenger-1774700868980.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2da150>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1222%252F20341222%252Finterior_dashboard-1774711566190.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1222/20341222/interior_dashboard-1774711566190.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d507850>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_rear_driver-1774700865959.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_driver-1774700865959.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_driver-1774700871001.jpg> (referer: None)
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d195550>
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1222%252F20341222%252Fexterior_front_driver-1774700871001.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_driver-1774700871001.jpg saved to cache
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03f04c35-001f-522f-93b8-88a24e915e66
2026-03-29 20:21:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03f04c35-001f-522f-93b8-88a24e915e66, skipping ID generation
2026-03-29 20:21:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f04c35-001f-522f-93b8-88a24e915e66 with scrape type 1
2026-03-29 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03f04c35-001f-522f-93b8-88a24e915e66 sending to next pipeline
2026-03-29 20:21:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 03f04c35-001f-522f-93b8-88a24e915e66, identifier: 20341222
2026-03-29 20:21:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 03f04c35-001f-522f-93b8-88a24e915e66 with identifier: 20341222
2026-03-29 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 03f04c35-001f-522f-93b8-88a24e915e66 with identifier: 20341222
2026-03-29 20:21:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 03f04c35-001f-522f-93b8-88a24e915e66 with identifier: 20341222 to the API
2026-03-29 20:21:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_driver-1774700871001.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '03f04c35-001f-522f-93b8-88a24e915e66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV23 EEA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20341222',
'listing': 'auction',
'location': 'Surrey Leatherhead',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 25515,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1768223,
'Height': 2781,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_driver-1774700871001.jpg',
'Width': 3708},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2074274,
'Height': 2784,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_driver-1774700865959.jpg',
'Width': 3712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1869747,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_front_passenger-1774700868980.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1318247,
'Height': 2337,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1222/20341222/exterior_rear_passenger-1774700864469.jpg',
'Width': 3116},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1537774,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1222/20341222/interior_front_seats-1774711548127.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1835783,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1222/20341222/interior_rear_seats-1774701270659.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1982224,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1222/20341222/interior_dashboard-1774711566190.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1481264,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1222/20341222/instrument_cluster-1774701304058.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2402676,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1222/20341222/interior_boot-1774711582262.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03f04c35-001f-522f-93b8-88a24e915e66/03f04c35-001f-522f-93b8-88a24e915e66_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586735,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1222/20341222/docs_service_history-1774701325400.jpg?ixlib=js-3.8.0&auto=format&s=b44301b621438367d2575ed8265471de',
'Width': 2880}],
'price': 19448,
'price_includes_vat': False,
'registration_date': '2023-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo GTI TSI S-A',
'transmission': 'automatic',
'trim': 'GTI TSI S-A',
'vin': 'WVWZZZAWZPU053222',
'year': 2023}
2026-03-29 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720341222%27 HTTP/1.1" 200 None
2026-03-29 20:21:34 [motorway.uk] INFO: Saving data for 20341222: {'created_time': 1774815694.48422, 'last_price_update_time': 1774815694.484233, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20341222') HTTP/1.1" 204 0
2026-03-29 20:21:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20390094.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd109f30-d155-5dc0-8265-17142de84af3 with identifier: 20390094
2026-03-29 20:21:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd109f30-d155-5dc0-8265-17142de84af3 with scrape type 1
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0094%252F20390094%252Fexterior_front_driver-1774697135588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_driver-1774697135588.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0094%252F20390094%252Fexterior_rear_driver-1774698778533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_driver-1774698778533.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0094%252F20390094%252Fexterior_front_passenger-1774697132424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_passenger-1774697132424.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0094%252F20390094%252Fexterior_rear_passenger-1774698874587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_passenger-1774698874587.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Finterior_front_seats-1774697716257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/interior_front_seats-1774697716257.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Finterior_rear_seats-1774697720501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/interior_rear_seats-1774697720501.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0094%252F20390094%252Finterior_dashboard-1774698754453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0094/20390094/interior_dashboard-1774698754453.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Finterior_boot-1774697718926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/interior_boot-1774697718926.jpg not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0094%252F20390094%252Fdocs_service_history-1774697984118.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cd43984773af2c510a9b4ba3092fc93%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0094/20390094/docs_service_history-1774697984118.jpg?ixlib=js-3.8.0&auto=format&s=5cd43984773af2c510a9b4ba3092fc93 not downloaded yet
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Fdamage_scratches-1774697222607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/damage_scratches-1774697222607.jpg not downloaded yet
2026-03-29 20:21:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20036264.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca with identifier: 20036264
2026-03-29 20:21:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca with scrape type 1
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_front_driver-1774696357119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_driver-1774696357119.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_rear_driver-1774696372508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_driver-1774696372508.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_front_passenger-1774696409499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_passenger-1774696409499.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_rear_passenger-1774696379950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_passenger-1774696379950.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6264%252F20036264%252Finterior_front_seats-1774697087339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6264/20036264/interior_front_seats-1774697087339.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6264%252F20036264%252Finterior_rear_seats-1774697101370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6264/20036264/interior_rear_seats-1774697101370.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Finterior_dashboard-1774697314278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/interior_dashboard-1774697314278.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Finstrument_cluster-1774697247703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/instrument_cluster-1774697247703.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6264%252F20036264%252Finterior_boot-1774697173740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6264/20036264/interior_boot-1774697173740.jpg not downloaded yet
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6264%252F20036264%252Fdocs_service_history-1774697469942.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5b307eb83735304a1c5d87da41f044da%27 HTTP/1.1" 200 None
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6264/20036264/docs_service_history-1774697469942.jpg?ixlib=js-3.8.0&auto=format&s=5b307eb83735304a1c5d87da41f044da not downloaded yet
2026-03-29 20:21:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0094/20390094/damage_scratches-1774697222607.jpg> (referer: None)
2026-03-29 20:21:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6264/20036264/docs_service_history-1774697469942.jpg?ixlib=js-3.8.0&auto=format&s=5b307eb83735304a1c5d87da41f044da> (referer: None)
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca72650>
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Fdamage_scratches-1774697222607.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/damage_scratches-1774697222607.jpg saved to cache
2026-03-29 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:21:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb94990>
2026-03-29 20:21:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6264%252F20036264%252Fdocs_service_history-1774697469942.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5b307eb83735304a1c5d87da41f044da') HTTP/1.1" 204 0
2026-03-29 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6264/20036264/docs_service_history-1774697469942.jpg?ixlib=js-3.8.0&auto=format&s=5b307eb83735304a1c5d87da41f044da saved to cache
2026-03-29 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6264/20036264/interior_boot-1774697173740.jpg> (referer: None)
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc71d0>
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6264%252F20036264%252Finterior_boot-1774697173740.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6264/20036264/interior_boot-1774697173740.jpg saved to cache
2026-03-29 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6264/20036264/instrument_cluster-1774697247703.jpg> (referer: None)
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d197410>
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Finstrument_cluster-1774697247703.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/instrument_cluster-1774697247703.jpg saved to cache
2026-03-29 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6264/20036264/interior_dashboard-1774697314278.jpg> (referer: None)
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc6b10>
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Finterior_dashboard-1774697314278.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/interior_dashboard-1774697314278.jpg saved to cache
2026-03-29 20:21:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6264/20036264/interior_rear_seats-1774697101370.jpg> (referer: None)
2026-03-29 20:21:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1948d0>
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6264%252F20036264%252Finterior_rear_seats-1774697101370.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6264/20036264/interior_rear_seats-1774697101370.jpg saved to cache
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6264/20036264/interior_front_seats-1774697087339.jpg> (referer: None)
2026-03-29 20:21:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb97890>
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6264%252F20036264%252Finterior_front_seats-1774697087339.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6264/20036264/interior_front_seats-1774697087339.jpg saved to cache
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_passenger-1774696379950.jpg> (referer: None)
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d195c50>
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_rear_passenger-1774696379950.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_passenger-1774696379950.jpg saved to cache
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_passenger-1774696409499.jpg> (referer: None)
2026-03-29 20:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=612&page=17&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e091310>
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_front_passenger-1774696409499.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_passenger-1774696409499.jpg saved to cache
2026-03-29 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20176261
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 17331668
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20454066
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18631801
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 3620067
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273620067%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 3620067: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20010331
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 6110693
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20212993
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18599819
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20478024
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20476322
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19989124
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20485342
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19346587
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719346587%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 19346587: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18465053
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718465053%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 18465053: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 17446512
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19535676
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20106291
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18846555
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19650847
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 16887046
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18297776
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19443439
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719443439%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 19443439: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20249715
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720249715%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 20249715: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18285367
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718285367%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 18285367: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 18824482
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718824482%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 18824482: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19548326
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19976408
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 17967491
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 8192755
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20357594
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20469292
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20467785
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20488132
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488132%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [motorway.uk] INFO: Scrape type for 20488132: 1
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 20001461
2026-03-29 20:21:45 [motorway.uk] INFO: Found listing with ID: 19942570
2026-03-29 20:21:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_driver-1774696372508.jpg> (referer: None)
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3c410>
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_rear_driver-1774696372508.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_driver-1774696372508.jpg saved to cache
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_driver-1774696357119.jpg> (referer: None)
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb99510>
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6264%252F20036264%252Fexterior_front_driver-1774696357119.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_driver-1774696357119.jpg saved to cache
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca
2026-03-29 20:21:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca, skipping ID generation
2026-03-29 20:21:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca with scrape type 1
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca sending to next pipeline
2026-03-29 20:21:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca, identifier: 20036264
2026-03-29 20:21:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca with identifier: 20036264
2026-03-29 20:21:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca with identifier: 20036264
2026-03-29 20:21:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 96fb7cae-87cc-55e6-8a04-9b3cfb4445ca with identifier: 20036264 to the API
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_driver-1774696357119.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '96fb7cae-87cc-55e6-8a04-9b3cfb4445ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU18 ZVT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20036264',
'listing': 'auction',
'location': 'Greater London Bromley',
'make': 'Audi',
'model': 'TT',
'odometer': 79524,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1551883,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_driver-1774696357119.jpg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1028196,
'Height': 2282,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_driver-1774696372508.jpg',
'Width': 3043},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1326522,
'Height': 2299,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_front_passenger-1774696409499.jpg',
'Width': 3065},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505910,
'Height': 2616,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6264/20036264/exterior_rear_passenger-1774696379950.jpg',
'Width': 3488},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3519712,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6264/20036264/interior_front_seats-1774697087339.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4103657,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6264/20036264/interior_rear_seats-1774697101370.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375098,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6264/20036264/interior_dashboard-1774697314278.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849914,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6264/20036264/instrument_cluster-1774697247703.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4316197,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6264/20036264/interior_boot-1774697173740.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fb7cae-87cc-55e6-8a04-9b3cfb4445ca/96fb7cae-87cc-55e6-8a04-9b3cfb4445ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84966,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6264/20036264/docs_service_history-1774697469942.jpg?ixlib=js-3.8.0&auto=format&s=5b307eb83735304a1c5d87da41f044da',
'Width': 596}],
'price': 10102,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi TT Sport TFSI S-A',
'transmission': 'automatic',
'trim': 'Sport TFSI S-A',
'vin': 'TRUZZZFV0J1008668',
'year': 2018}
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720036264%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [motorway.uk] INFO: Saving data for 20036264: {'created_time': 1774815706.304662, 'last_price_update_time': 1774815706.304674, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20036264') HTTP/1.1" 204 0
2026-03-29 20:21:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/2726366.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74936303-29ee-5997-9803-a9fb0c850e51 with identifier: 2726366
2026-03-29 20:21:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74936303-29ee-5997-9803-a9fb0c850e51 with scrape type 1
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_front_driver-1774704791609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_driver-1774704791609.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_rear_driver-1774704810425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_rear_driver-1774704810425.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_front_passenger-1774704838810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_passenger-1774704838810.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_rear_passenger-1774704825097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_rear_passenger-1774704825097.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6366%252F2726366%252Finterior_front_seats-1774707950555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6366/2726366/interior_front_seats-1774707950555.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6366%252F2726366%252Finterior_rear_seats-1774705281101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6366/2726366/interior_rear_seats-1774705281101.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6366%252F2726366%252Finterior_dashboard-1774707069676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6366/2726366/interior_dashboard-1774707069676.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6366%252F2726366%252Finterior_boot-1774705322621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6366/2726366/interior_boot-1774705322621.jpg not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6366%252F2726366%252Fdocs_service_history-1774705720664.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D575124a258e938c5e6ca067efc606728%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6366/2726366/docs_service_history-1774705720664.jpg?ixlib=js-3.8.0&auto=format&s=575124a258e938c5e6ca067efc606728 not downloaded yet
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6366%252F2726366%252Fdocs_service_history-1774707668065.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfdff057f9107329892b0c3ddec12f3b9%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6366/2726366/docs_service_history-1774707668065.jpg?ixlib=js-3.8.0&auto=format&s=fdff057f9107329892b0c3ddec12f3b9 not downloaded yet
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20444590.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d042e5b5-0786-53d1-8032-3183615dad21 with identifier: 20444590
2026-03-29 20:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d042e5b5-0786-53d1-8032-3183615dad21 with scrape type 1
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Fexterior_front_driver-1774706389589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_front_driver-1774706389589.jpg not downloaded yet
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6366/2726366/docs_service_history-1774707668065.jpg?ixlib=js-3.8.0&auto=format&s=fdff057f9107329892b0c3ddec12f3b9> (referer: None)
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Fexterior_rear_driver-1774706408399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_driver-1774706408399.jpg not downloaded yet
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4590%252F20444590%252Fexterior_front_passenger-1774786007296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4590/20444590/exterior_front_passenger-1774786007296.jpg not downloaded yet
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Fexterior_rear_passenger-1774706436079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_passenger-1774706436079.jpg not downloaded yet
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4590%252F20444590%252Finterior_front_seats-1774719933115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4590/20444590/interior_front_seats-1774719933115.jpg not downloaded yet
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4590%252F20444590%252Finterior_rear_seats-1774720121743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4590/20444590/interior_rear_seats-1774720121743.jpg not downloaded yet
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Finterior_dashboard-1774718990767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/interior_dashboard-1774718990767.jpg not downloaded yet
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf3ebd0>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6366%252F2726366%252Fdocs_service_history-1774707668065.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfdff057f9107329892b0c3ddec12f3b9') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6366/2726366/docs_service_history-1774707668065.jpg?ixlib=js-3.8.0&auto=format&s=fdff057f9107329892b0c3ddec12f3b9 saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Finstrument_cluster-1774783498043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/instrument_cluster-1774783498043.jpg not downloaded yet
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4590%252F20444590%252Finterior_boot-1774720131157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4590/20444590/interior_boot-1774720131157.jpg not downloaded yet
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4590%252F20444590%252Fdocs_service_history-1774719582750.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D36f8b5af4c37a4320a6a5bf0b60feb99%27 HTTP/1.1" 200 None
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4590/20444590/docs_service_history-1774719582750.jpg?ixlib=js-3.8.0&auto=format&s=36f8b5af4c37a4320a6a5bf0b60feb99 not downloaded yet
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_front_driver-1774706389589.jpg> (referer: None)
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca99bd0>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Fexterior_front_driver-1774706389589.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_front_driver-1774706389589.jpg saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4590/20444590/docs_service_history-1774719582750.jpg?ixlib=js-3.8.0&auto=format&s=36f8b5af4c37a4320a6a5bf0b60feb99> (referer: None)
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2c6910>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4590%252F20444590%252Fdocs_service_history-1774719582750.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D36f8b5af4c37a4320a6a5bf0b60feb99') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4590/20444590/docs_service_history-1774719582750.jpg?ixlib=js-3.8.0&auto=format&s=36f8b5af4c37a4320a6a5bf0b60feb99 saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4590/20444590/interior_boot-1774720131157.jpg> (referer: None)
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d506b50>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4590%252F20444590%252Finterior_boot-1774720131157.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4590/20444590/interior_boot-1774720131157.jpg saved to cache
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14717398.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c800af0-e1c3-5709-90b8-9933dac084e7 with identifier: 14717398
2026-03-29 20:21:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c800af0-e1c3-5709-90b8-9933dac084e7 with scrape type 1
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_front_driver-1774367887582.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_driver-1774367887582.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_rear_driver-1774367916365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_driver-1774367916365.jpg not downloaded yet
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18667851.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_front_passenger-1774367959199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_passenger-1774367959199.jpg not downloaded yet
2026-03-29 20:21:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_rear_passenger-1774367947471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_passenger-1774367947471.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F14717398%252Finterior_front_seats-1774452959773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/14717398/interior_front_seats-1774452959773.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F14717398%252Finterior_rear_seats-1774461824460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/14717398/interior_rear_seats-1774461824460.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Finterior_dashboard-1774453003888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/interior_dashboard-1774453003888.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F14717398%252Finterior_boot-1774453011774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/14717398/interior_boot-1774453011774.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7398%252F14717398%252Fdocs_service_history-1774462022328.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3672811ad88470e774732957f3e639b%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7398/14717398/docs_service_history-1774462022328.jpg?ixlib=js-3.8.0&auto=format&s=b3672811ad88470e774732957f3e639b not downloaded yet
2026-03-29 20:21:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c55015e-ba4d-575b-bb04-7737c45a1797 with identifier: 18667851
2026-03-29 20:21:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c55015e-ba4d-575b-bb04-7737c45a1797 with scrape type 1
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_front_driver-1774786317885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_driver-1774786317885.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7398%252F14717398%252F14717398-docs_service_history-modified-1774688427254.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7a6f050f3707889b8156d32f2f8e2a7f%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7398/14717398/14717398-docs_service_history-modified-1774688427254.jpeg?ixlib=js-3.8.0&auto=format&s=7a6f050f3707889b8156d32f2f8e2a7f not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_rear_driver-1774786338448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_driver-1774786338448.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_front_passenger-1774786366184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_passenger-1774786366184.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_rear_passenger-1774786350507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_passenger-1774786350507.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7851%252F18667851%252Finterior_front_seats-1774796217570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7851/18667851/interior_front_seats-1774796217570.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7851%252F18667851%252Finterior_rear_seats-1774787307623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7851/18667851/interior_rear_seats-1774787307623.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Finterior_dashboard-1774787334342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/interior_dashboard-1774787334342.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Finstrument_cluster-1774787367816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/instrument_cluster-1774787367816.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7851%252F18667851%252Finterior_boot-1774787359905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7851/18667851/interior_boot-1774787359905.jpg not downloaded yet
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7851%252F18667851%252Fdocs_service_history-1774796297887.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1b9c0e5ed14224a8aa901dabd8fc07a%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7851/18667851/docs_service_history-1774796297887.jpg?ixlib=js-3.8.0&auto=format&s=c1b9c0e5ed14224a8aa901dabd8fc07a not downloaded yet
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4590/20444590/interior_dashboard-1774718990767.jpg> (referer: None)
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4590/20444590/instrument_cluster-1774783498043.jpg> (referer: None)
2026-03-29 20:21:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c247b50>
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Finterior_dashboard-1774718990767.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/interior_dashboard-1774718990767.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7851/18667851/docs_service_history-1774796297887.jpg?ixlib=js-3.8.0&auto=format&s=c1b9c0e5ed14224a8aa901dabd8fc07a> (referer: None)
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d146950>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Finstrument_cluster-1774783498043.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/instrument_cluster-1774783498043.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_driver-1774367916365.jpg> (referer: None)
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e33d0>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7851%252F18667851%252Fdocs_service_history-1774796297887.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1b9c0e5ed14224a8aa901dabd8fc07a') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7851/18667851/docs_service_history-1774796297887.jpg?ixlib=js-3.8.0&auto=format&s=c1b9c0e5ed14224a8aa901dabd8fc07a saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca485d0>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_rear_driver-1774367916365.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_driver-1774367916365.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7851/18667851/instrument_cluster-1774787367816.jpg> (referer: None)
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7851/18667851/interior_boot-1774787359905.jpg> (referer: None)
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d302f50>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Finstrument_cluster-1774787367816.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/instrument_cluster-1774787367816.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4b610>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7851%252F18667851%252Finterior_boot-1774787359905.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7851/18667851/interior_boot-1774787359905.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7851/18667851/interior_dashboard-1774787334342.jpg> (referer: None)
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7851/18667851/interior_rear_seats-1774787307623.jpg> (referer: None)
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d544210>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Finterior_dashboard-1774787334342.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/interior_dashboard-1774787334342.jpg saved to cache
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e3450>
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7851%252F18667851%252Finterior_rear_seats-1774787307623.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7851/18667851/interior_rear_seats-1774787307623.jpg saved to cache
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7851/18667851/interior_front_seats-1774796217570.jpg> (referer: None)
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_passenger-1774786350507.jpg> (referer: None)
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d547790>
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7851%252F18667851%252Finterior_front_seats-1774796217570.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7851/18667851/interior_front_seats-1774796217570.jpg saved to cache
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf02a10>
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_rear_passenger-1774786350507.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_passenger-1774786350507.jpg saved to cache
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7398/14717398/14717398-docs_service_history-modified-1774688427254.jpeg?ixlib=js-3.8.0&auto=format&s=7a6f050f3707889b8156d32f2f8e2a7f> (referer: None)
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_driver-1774786338448.jpg> (referer: None)
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d544f50>
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7398%252F14717398%252F14717398-docs_service_history-modified-1774688427254.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7a6f050f3707889b8156d32f2f8e2a7f') HTTP/1.1" 204 0
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7398/14717398/14717398-docs_service_history-modified-1774688427254.jpeg?ixlib=js-3.8.0&auto=format&s=7a6f050f3707889b8156d32f2f8e2a7f saved to cache
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3012d0>
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_rear_driver-1774786338448.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_driver-1774786338448.jpg saved to cache
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_passenger-1774786366184.jpg> (referer: None)
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7398/14717398/docs_service_history-1774462022328.jpg?ixlib=js-3.8.0&auto=format&s=b3672811ad88470e774732957f3e639b> (referer: None)
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_driver-1774786317885.jpg> (referer: None)
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d779090>
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_front_passenger-1774786366184.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_passenger-1774786366184.jpg saved to cache
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e3110>
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7398%252F14717398%252Fdocs_service_history-1774462022328.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3672811ad88470e774732957f3e639b') HTTP/1.1" 204 0
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7398/14717398/docs_service_history-1774462022328.jpg?ixlib=js-3.8.0&auto=format&s=b3672811ad88470e774732957f3e639b saved to cache
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1450d0>
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7851%252F18667851%252Fexterior_front_driver-1774786317885.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_driver-1774786317885.jpg saved to cache
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c55015e-ba4d-575b-bb04-7737c45a1797
2026-03-29 20:22:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c55015e-ba4d-575b-bb04-7737c45a1797, skipping ID generation
2026-03-29 20:22:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c55015e-ba4d-575b-bb04-7737c45a1797 with scrape type 1
2026-03-29 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c55015e-ba4d-575b-bb04-7737c45a1797 sending to next pipeline
2026-03-29 20:22:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7c55015e-ba4d-575b-bb04-7737c45a1797, identifier: 18667851
2026-03-29 20:22:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7c55015e-ba4d-575b-bb04-7737c45a1797 with identifier: 18667851
2026-03-29 20:22:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7c55015e-ba4d-575b-bb04-7737c45a1797 with identifier: 18667851
2026-03-29 20:22:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7c55015e-ba4d-575b-bb04-7737c45a1797 with identifier: 18667851 to the API
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_driver-1774786317885.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7c55015e-ba4d-575b-bb04-7737c45a1797',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KX67 YNA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18667851',
'listing': 'auction',
'location': 'Hampshire Hindhead',
'make': 'Audi',
'model': 'S4',
'odometer': 82500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1439359,
'Height': 2358,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_driver-1774786317885.jpg',
'Width': 3144},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1386887,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_driver-1774786338448.jpg',
'Width': 3219},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1693942,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_front_passenger-1774786366184.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1853345,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7851/18667851/exterior_rear_passenger-1774786350507.jpg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801879,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7851/18667851/interior_front_seats-1774796217570.jpg',
'Width': 3385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2792328,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7851/18667851/interior_rear_seats-1774787307623.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3382761,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7851/18667851/interior_dashboard-1774787334342.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2628175,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7851/18667851/instrument_cluster-1774787367816.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4137583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7851/18667851/interior_boot-1774787359905.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c55015e-ba4d-575b-bb04-7737c45a1797/7c55015e-ba4d-575b-bb04-7737c45a1797_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485979,
'Height': 2643,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7851/18667851/docs_service_history-1774796297887.jpg?ixlib=js-3.8.0&auto=format&s=c1b9c0e5ed14224a8aa901dabd8fc07a',
'Width': 1982}],
'price': 17753,
'price_includes_vat': False,
'registration_date': '2017-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi S4 TFSI Quattro Auto',
'transmission': 'automatic',
'trim': 'TFSI Quattro Auto',
'vin': 'WAUZZZF42HA173727',
'year': 2017}
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718667851%27 HTTP/1.1" 200 None
2026-03-29 20:22:02 [motorway.uk] INFO: Saving data for 18667851: {'created_time': 1774815722.812428, 'last_price_update_time': 1774815722.812441, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18667851') HTTP/1.1" 204 0
2026-03-29 20:22:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7398/14717398/interior_dashboard-1774453003888.jpg> (referer: None)
2026-03-29 20:22:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7398/14717398/interior_rear_seats-1774461824460.jpg> (referer: None)
2026-03-29 20:22:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7398/14717398/interior_boot-1774453011774.jpg> (referer: None)
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d546090>
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Finterior_dashboard-1774453003888.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/interior_dashboard-1774453003888.jpg saved to cache
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e924e90>
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F14717398%252Finterior_rear_seats-1774461824460.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/14717398/interior_rear_seats-1774461824460.jpg saved to cache
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3b390>
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F14717398%252Finterior_boot-1774453011774.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/14717398/interior_boot-1774453011774.jpg saved to cache
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_passenger-1774367947471.jpg> (referer: None)
2026-03-29 20:22:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7398/14717398/interior_front_seats-1774452959773.jpg> (referer: None)
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d144650>
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_rear_passenger-1774367947471.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_passenger-1774367947471.jpg saved to cache
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d268e50>
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F14717398%252Finterior_front_seats-1774452959773.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/14717398/interior_front_seats-1774452959773.jpg saved to cache
2026-03-29 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_driver-1774367887582.jpg> (referer: None)
2026-03-29 20:22:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_passenger-1774367959199.jpg> (referer: None)
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c685910>
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_front_driver-1774367887582.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_driver-1774367887582.jpg saved to cache
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4a950>
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F14717398%252Fexterior_front_passenger-1774367959199.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_passenger-1774367959199.jpg saved to cache
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c800af0-e1c3-5709-90b8-9933dac084e7
2026-03-29 20:22:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c800af0-e1c3-5709-90b8-9933dac084e7, skipping ID generation
2026-03-29 20:22:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c800af0-e1c3-5709-90b8-9933dac084e7 with scrape type 1
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c800af0-e1c3-5709-90b8-9933dac084e7 sending to next pipeline
2026-03-29 20:22:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4c800af0-e1c3-5709-90b8-9933dac084e7, identifier: 14717398
2026-03-29 20:22:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4c800af0-e1c3-5709-90b8-9933dac084e7 with identifier: 14717398
2026-03-29 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4c800af0-e1c3-5709-90b8-9933dac084e7 with identifier: 14717398
2026-03-29 20:22:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4c800af0-e1c3-5709-90b8-9933dac084e7 with identifier: 14717398 to the API
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_passenger-1774367959199.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4c800af0-e1c3-5709-90b8-9933dac084e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX69 SDO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14717398',
'listing': 'auction',
'location': 'Greater Manchester Cheadle',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 45000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1858720,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_driver-1774367887582.jpg',
'Width': 3406},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1933078,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_driver-1774367916365.jpg',
'Width': 3399},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1357476,
'Height': 2158,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_front_passenger-1774367959199.jpg',
'Width': 2877},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1829473,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7398/14717398/exterior_rear_passenger-1774367947471.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3714049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7398/14717398/interior_front_seats-1774452959773.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3418725,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7398/14717398/interior_rear_seats-1774461824460.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1572149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7398/14717398/interior_dashboard-1774453003888.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4445905,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7398/14717398/interior_boot-1774453011774.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1448667,
'Height': 1300,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7398/14717398/docs_service_history-1774462022328.jpg?ixlib=js-3.8.0&auto=format&s=b3672811ad88470e774732957f3e639b',
'Width': 2665},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c800af0-e1c3-5709-90b8-9933dac084e7/4c800af0-e1c3-5709-90b8-9933dac084e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239228,
'Height': 1535,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7398/14717398/14717398-docs_service_history-modified-1774688427254.jpeg?ixlib=js-3.8.0&auto=format&s=7a6f050f3707889b8156d32f2f8e2a7f',
'Width': 1152}],
'price': 15259,
'price_includes_vat': False,
'registration_date': '2019-10-24',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-5 Sport NAV + Auto',
'transmission': 'automatic',
'trim': 'Sport NAV + Auto',
'vin': 'JMZKF6W7A00873014',
'year': 2019}
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714717398%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [motorway.uk] INFO: Saving data for 14717398: {'created_time': 1774815724.822331, 'last_price_update_time': 1774815724.822343, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14717398') HTTP/1.1" 204 0
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4590/20444590/interior_rear_seats-1774720121743.jpg> (referer: None)
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_passenger-1774706436079.jpg> (referer: None)
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4590/20444590/interior_front_seats-1774719933115.jpg> (referer: None)
2026-03-29 20:22:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:22:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac9c10>
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4590%252F20444590%252Finterior_rear_seats-1774720121743.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4590/20444590/interior_rear_seats-1774720121743.jpg saved to cache
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24e010>
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Fexterior_rear_passenger-1774706436079.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_passenger-1774706436079.jpg saved to cache
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7f0d0>
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4590%252F20444590%252Finterior_front_seats-1774719933115.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4590/20444590/interior_front_seats-1774719933115.jpg saved to cache
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484266.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced35f07-4ca6-5961-bbca-9aed3f829d8d with identifier: 20484266
2026-03-29 20:22:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced35f07-4ca6-5961-bbca-9aed3f829d8d with scrape type 1
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4266%252F20484266%252Fexterior_front_driver-1774690461734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_driver-1774690461734.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4266%252F20484266%252Fexterior_rear_driver-1774692778278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4266/20484266/exterior_rear_driver-1774692778278.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4266%252F20484266%252Fexterior_front_passenger-1774690463694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_passenger-1774690463694.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4266%252F20484266%252Fexterior_rear_passenger-1774690470309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_rear_passenger-1774690470309.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4266%252F20484266%252Finterior_front_seats-1774691598800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4266/20484266/interior_front_seats-1774691598800.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4266%252F20484266%252Finterior_rear_seats-1774691635283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4266/20484266/interior_rear_seats-1774691635283.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4266%252F20484266%252Finterior_dashboard-1774692877099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4266/20484266/interior_dashboard-1774692877099.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4266%252F20484266%252Finterior_boot-1774691596978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4266/20484266/interior_boot-1774691596978.jpg not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4266%252F20484266%252Fdocs_service_history-1774691858312.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df6622db8c129ff664736b67cb631ff60%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691858312.jpg?ixlib=js-3.8.0&auto=format&s=f6622db8c129ff664736b67cb631ff60 not downloaded yet
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4266%252F20484266%252Fdocs_service_history-1774691865107.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D01c7c2aab981daf46aee3b4eb0b7a5e6%27 HTTP/1.1" 200 None
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691865107.jpg?ixlib=js-3.8.0&auto=format&s=01c7c2aab981daf46aee3b4eb0b7a5e6 not downloaded yet
2026-03-29 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6366/2726366/docs_service_history-1774705720664.jpg?ixlib=js-3.8.0&auto=format&s=575124a258e938c5e6ca067efc606728> (referer: None)
2026-03-29 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4590/20444590/exterior_front_passenger-1774786007296.jpg> (referer: None)
2026-03-29 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_driver-1774706408399.jpg> (referer: None)
2026-03-29 20:22:05 [scrapy.extensions.logstats] INFO: Crawled 174 pages (at 18 pages/min), scraped 138 items (at 10 items/min)
2026-03-29 20:22:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28f150>
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6366%252F2726366%252Fdocs_service_history-1774705720664.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D575124a258e938c5e6ca067efc606728') HTTP/1.1" 204 0
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6366/2726366/docs_service_history-1774705720664.jpg?ixlib=js-3.8.0&auto=format&s=575124a258e938c5e6ca067efc606728 saved to cache
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6366/2726366/interior_boot-1774705322621.jpg> (referer: None)
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d187250>
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4590%252F20444590%252Fexterior_front_passenger-1774786007296.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4590/20444590/exterior_front_passenger-1774786007296.jpg saved to cache
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec16950>
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4590%252F20444590%252Fexterior_rear_driver-1774706408399.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_driver-1774706408399.jpg saved to cache
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d042e5b5-0786-53d1-8032-3183615dad21
2026-03-29 20:22:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d042e5b5-0786-53d1-8032-3183615dad21, skipping ID generation
2026-03-29 20:22:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d042e5b5-0786-53d1-8032-3183615dad21 with scrape type 1
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d042e5b5-0786-53d1-8032-3183615dad21 sending to next pipeline
2026-03-29 20:22:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d042e5b5-0786-53d1-8032-3183615dad21, identifier: 20444590
2026-03-29 20:22:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d042e5b5-0786-53d1-8032-3183615dad21 with identifier: 20444590
2026-03-29 20:22:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d042e5b5-0786-53d1-8032-3183615dad21 with identifier: 20444590
2026-03-29 20:22:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d042e5b5-0786-53d1-8032-3183615dad21 with identifier: 20444590 to the API
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_driver-1774706408399.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd042e5b5-0786-53d1-8032-3183615dad21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW65 RJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20444590',
'listing': 'auction',
'location': 'East Sussex Seaford',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 62520,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2015074,
'Height': 2774,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_front_driver-1774706389589.jpg',
'Width': 3698},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1929742,
'Height': 2746,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_driver-1774706408399.jpg',
'Width': 3661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2581574,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4590/20444590/exterior_front_passenger-1774786007296.jpg',
'Width': 3711},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1853403,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4590/20444590/exterior_rear_passenger-1774706436079.jpg',
'Width': 3599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5057703,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4590/20444590/interior_front_seats-1774719933115.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5021435,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4590/20444590/interior_rear_seats-1774720121743.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3522375,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4590/20444590/interior_dashboard-1774718990767.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3339446,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4590/20444590/instrument_cluster-1774783498043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6679460,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4590/20444590/interior_boot-1774720131157.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d042e5b5-0786-53d1-8032-3183615dad21/d042e5b5-0786-53d1-8032-3183615dad21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3271630,
'Height': 3046,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4590/20444590/docs_service_history-1774719582750.jpg?ixlib=js-3.8.0&auto=format&s=36f8b5af4c37a4320a6a5bf0b60feb99',
'Width': 2229}],
'price': 6316,
'price_includes_vat': False,
'registration_date': '2016-01-30',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE TSI',
'transmission': 'manual',
'trim': 'SE TSI',
'vin': 'WVWZZZ6RZGU028420',
'year': 2016}
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720444590%27 HTTP/1.1" 200 None
2026-03-29 20:22:06 [motorway.uk] INFO: Saving data for 20444590: {'created_time': 1774815726.727924, 'last_price_update_time': 1774815726.727934, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20444590') HTTP/1.1" 204 0
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce655d0>
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6366%252F2726366%252Finterior_boot-1774705322621.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6366/2726366/interior_boot-1774705322621.jpg saved to cache
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691858312.jpg?ixlib=js-3.8.0&auto=format&s=f6622db8c129ff664736b67cb631ff60> (referer: None)
2026-03-29 20:22:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691865107.jpg?ixlib=js-3.8.0&auto=format&s=01c7c2aab981daf46aee3b4eb0b7a5e6> (referer: None)
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c242bd0>
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4266%252F20484266%252Fdocs_service_history-1774691858312.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df6622db8c129ff664736b67cb631ff60') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691858312.jpg?ixlib=js-3.8.0&auto=format&s=f6622db8c129ff664736b67cb631ff60 saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d020350>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4266%252F20484266%252Fdocs_service_history-1774691865107.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D01c7c2aab981daf46aee3b4eb0b7a5e6') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691865107.jpg?ixlib=js-3.8.0&auto=format&s=01c7c2aab981daf46aee3b4eb0b7a5e6 saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20331785.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4266/20484266/interior_front_seats-1774691598800.jpg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4266/20484266/interior_boot-1774691596978.jpg> (referer: None)
2026-03-29 20:22:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f18b301-e8c6-556b-9ceb-7c556548b7a3 with identifier: 20331785
2026-03-29 20:22:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3 with scrape type 1
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_front_driver-1773856730366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_driver-1773856730366.jpg not downloaded yet
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4266/20484266/interior_rear_seats-1774691635283.jpg> (referer: None)
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_rear_driver-1773856760096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_driver-1773856760096.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_front_passenger-1773856800948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_passenger-1773856800948.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_rear_passenger-1773856779790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_passenger-1773856779790.jpg not downloaded yet
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed72090>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4266%252F20484266%252Finterior_front_seats-1774691598800.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4266/20484266/interior_front_seats-1774691598800.jpg saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1785%252F20331785%252Finterior_front_seats-1774707441971.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1785/20331785/interior_front_seats-1774707441971.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1785%252F20331785%252Finterior_rear_seats-1773857599010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1785/20331785/interior_rear_seats-1773857599010.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1785%252F20331785%252Finterior_dashboard-1774707104702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1785/20331785/interior_dashboard-1774707104702.jpg not downloaded yet
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e02e2d0>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4266%252F20484266%252Finterior_boot-1774691596978.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4266/20484266/interior_boot-1774691596978.jpg saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf062d0>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4266%252F20484266%252Finterior_rear_seats-1774691635283.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4266/20484266/interior_rear_seats-1774691635283.jpg saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1785%252F20331785%252Finterior_boot-1773857659428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1785/20331785/interior_boot-1773857659428.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1785%252F20331785%252Fdocs_service_history-1774707011085.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3bbe5b289c66d72182eeefee15b31b2b%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707011085.jpg?ixlib=js-3.8.0&auto=format&s=3bbe5b289c66d72182eeefee15b31b2b not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1785%252F20331785%252Fdocs_service_history-1774707027239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e0b5ceaaea07f08975f5aef87ed3ce6%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707027239.jpg?ixlib=js-3.8.0&auto=format&s=1e0b5ceaaea07f08975f5aef87ed3ce6 not downloaded yet
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4266/20484266/interior_dashboard-1774692877099.jpg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_rear_passenger-1774690470309.jpg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_passenger-1774690463694.jpg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4266/20484266/exterior_rear_driver-1774692778278.jpg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_driver-1773856730366.jpg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707011085.jpg?ixlib=js-3.8.0&auto=format&s=3bbe5b289c66d72182eeefee15b31b2b> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707027239.jpg?ixlib=js-3.8.0&auto=format&s=1e0b5ceaaea07f08975f5aef87ed3ce6> (referer: None)
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54e490>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4266%252F20484266%252Finterior_dashboard-1774692877099.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4266/20484266/interior_dashboard-1774692877099.jpg saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d546410>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4266%252F20484266%252Fexterior_rear_passenger-1774690470309.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_rear_passenger-1774690470309.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d147650>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4266%252F20484266%252Fexterior_front_passenger-1774690463694.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_passenger-1774690463694.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d191b50>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4266%252F20484266%252Fexterior_rear_driver-1774692778278.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4266/20484266/exterior_rear_driver-1774692778278.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00d090>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_front_driver-1773856730366.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_driver-1773856730366.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d190190>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1785%252F20331785%252Fdocs_service_history-1774707011085.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3bbe5b289c66d72182eeefee15b31b2b') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707011085.jpg?ixlib=js-3.8.0&auto=format&s=3bbe5b289c66d72182eeefee15b31b2b saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d300110>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1785%252F20331785%252Fdocs_service_history-1774707027239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e0b5ceaaea07f08975f5aef87ed3ce6') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707027239.jpg?ixlib=js-3.8.0&auto=format&s=1e0b5ceaaea07f08975f5aef87ed3ce6 saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1785/20331785/interior_dashboard-1774707104702.jpg> (referer: None)
2026-03-29 20:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1785/20331785/interior_front_seats-1774707441971.jpg> (referer: None)
2026-03-29 20:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1785/20331785/interior_boot-1773857659428.jpg> (referer: None)
2026-03-29 20:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18989112.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14bdbd50>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1785%252F20331785%252Finterior_dashboard-1774707104702.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1785/20331785/interior_dashboard-1774707104702.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3f94d0>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1785%252F20331785%252Finterior_front_seats-1774707441971.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1785/20331785/interior_front_seats-1774707441971.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28b990>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1785%252F20331785%252Finterior_boot-1773857659428.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1785/20331785/interior_boot-1773857659428.jpg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab with identifier: 18989112
2026-03-29 20:22:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab with scrape type 1
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Fexterior_front_driver-1774614429384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_driver-1774614429384.jpg not downloaded yet
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Fexterior_rear_driver-1774614445201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_rear_driver-1774614445201.jpg not downloaded yet
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Fexterior_front_passenger-1774614474811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_passenger-1774614474811.jpg not downloaded yet
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9112%252F18989112%252Fexterior_rear_passenger-1774623622418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9112/18989112/exterior_rear_passenger-1774623622418.jpg not downloaded yet
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9112%252F18989112%252Finterior_front_seats-1774614883178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9112/18989112/interior_front_seats-1774614883178.jpg not downloaded yet
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9112%252F18989112%252Finterior_rear_seats-1774614899217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9112/18989112/interior_rear_seats-1774614899217.jpg not downloaded yet
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9112%252F18989112%252Finterior_dashboard-1774623641406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9112/18989112/interior_dashboard-1774623641406.jpg not downloaded yet
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_passenger-1773856779790.jpg> (referer: None)
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Finstrument_cluster-1774614969445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/instrument_cluster-1774614969445.jpg not downloaded yet
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_passenger-1773856800948.jpg> (referer: None)
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9112%252F18989112%252Finterior_boot-1774614945141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9112/18989112/interior_boot-1774614945141.jpg not downloaded yet
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9112%252F18989112%252Fdocs_service_history-1774615325070.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e2fb376e3e133b3019de5fd1689c2df%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9112/18989112/docs_service_history-1774615325070.jpg?ixlib=js-3.8.0&auto=format&s=3e2fb376e3e133b3019de5fd1689c2df not downloaded yet
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_driver-1773856760096.jpg> (referer: None)
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1785/20331785/interior_rear_seats-1773857599010.jpg> (referer: None)
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce71d10>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_rear_passenger-1773856779790.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_passenger-1773856779790.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca7290>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_front_passenger-1773856800948.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_passenger-1773856800948.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d26b8d0>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1785%252F20331785%252Fexterior_rear_driver-1773856760096.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_driver-1773856760096.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d241790>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1785%252F20331785%252Finterior_rear_seats-1773857599010.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1785/20331785/interior_rear_seats-1773857599010.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3
2026-03-29 20:22:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f18b301-e8c6-556b-9ceb-7c556548b7a3, skipping ID generation
2026-03-29 20:22:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3 with scrape type 1
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f18b301-e8c6-556b-9ceb-7c556548b7a3 sending to next pipeline
2026-03-29 20:22:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0f18b301-e8c6-556b-9ceb-7c556548b7a3, identifier: 20331785
2026-03-29 20:22:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0f18b301-e8c6-556b-9ceb-7c556548b7a3 with identifier: 20331785
2026-03-29 20:22:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0f18b301-e8c6-556b-9ceb-7c556548b7a3 with identifier: 20331785
2026-03-29 20:22:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0f18b301-e8c6-556b-9ceb-7c556548b7a3 with identifier: 20331785 to the API
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1785/20331785/interior_rear_seats-1773857599010.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '0f18b301-e8c6-556b-9ceb-7c556548b7a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN21 RPV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20331785',
'listing': 'auction',
'location': 'Hampshire Waterlooville',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 54029,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1448689,
'Height': 2708,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_driver-1773856730366.jpg',
'Width': 3610},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1368427,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_driver-1773856760096.jpg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1268359,
'Height': 2623,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_front_passenger-1773856800948.jpg',
'Width': 3497},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1137793,
'Height': 2668,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1785/20331785/exterior_rear_passenger-1773856779790.jpg',
'Width': 3557},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2175058,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1785/20331785/interior_front_seats-1774707441971.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2797209,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1785/20331785/interior_rear_seats-1773857599010.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2239880,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1785/20331785/interior_dashboard-1774707104702.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2865373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1785/20331785/interior_boot-1773857659428.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305744,
'Height': 1804,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707011085.jpg?ixlib=js-3.8.0&auto=format&s=3bbe5b289c66d72182eeefee15b31b2b',
'Width': 2405},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f18b301-e8c6-556b-9ceb-7c556548b7a3/0f18b301-e8c6-556b-9ceb-7c556548b7a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240243,
'Height': 1809,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1785/20331785/docs_service_history-1774707027239.jpg?ixlib=js-3.8.0&auto=format&s=1e0b5ceaaea07f08975f5aef87ed3ce6',
'Width': 2412}],
'price': 9607,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson SE NAV48V MHEV CRDI 2WD',
'transmission': 'manual',
'trim': 'SE NAV48V MHEV CRDI 2WD',
'vin': 'TMAJ3817LLJ145932',
'year': 2021}
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720331785%27 HTTP/1.1" 200 None
2026-03-29 20:22:10 [motorway.uk] INFO: Saving data for 20331785: {'created_time': 1774815730.225667, 'last_price_update_time': 1774815730.225677, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20331785') HTTP/1.1" 204 0
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18332731.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_driver-1774614429384.jpg> (referer: None)
2026-03-29 20:22:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9112/18989112/docs_service_history-1774615325070.jpg?ixlib=js-3.8.0&auto=format&s=3e2fb376e3e133b3019de5fd1689c2df> (referer: None)
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9112/18989112/interior_dashboard-1774623641406.jpg> (referer: None)
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9112/18989112/instrument_cluster-1774614969445.jpg> (referer: None)
2026-03-29 20:22:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4d2618-29c4-5668-ac5d-f87a2c24e130 with identifier: 18332731
2026-03-29 20:22:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4d2618-29c4-5668-ac5d-f87a2c24e130 with scrape type 1
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_front_driver-1774694722129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_driver-1774694722129.jpg not downloaded yet
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_rear_driver-1774694750834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_driver-1774694750834.jpg not downloaded yet
2026-03-29 20:22:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ced35f07-4ca6-5961-bbca-9aed3f829d8d with identifier: 20484266
2026-03-29 20:22:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ced35f07-4ca6-5961-bbca-9aed3f829d8d with identifier: 20484266
2026-03-29 20:22:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ced35f07-4ca6-5961-bbca-9aed3f829d8d with identifier: 20484266 to the API
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:10 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ced35f07-4ca6-5961-bbca-9aed3f829d8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YY18 GZC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484266',
'listing': 'auction',
'location': 'Greater Manchester Sale',
'make': 'Ford',
'model': 'Kuga',
'odometer': 60652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_driver-1774690461734.jpg',
'https://motorway-photos-modified.imgix.net/4266/20484266/exterior_rear_driver-1774692778278.jpg',
'https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_passenger-1774690463694.jpg',
'https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_rear_passenger-1774690470309.jpg',
'https://motorway-photos.imgix.net/4266/20484266/interior_front_seats-1774691598800.jpg',
'https://motorway-photos.imgix.net/4266/20484266/interior_rear_seats-1774691635283.jpg',
'https://motorway-photos-modified.imgix.net/4266/20484266/interior_dashboard-1774692877099.jpg',
'https://motorway-photos.imgix.net/4266/20484266/interior_boot-1774691596978.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691858312.jpg?ixlib=js-3.8.0&auto=format&s=f6622db8c129ff664736b67cb631ff60',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691865107.jpg?ixlib=js-3.8.0&auto=format&s=01c7c2aab981daf46aee3b4eb0b7a5e6'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1010774,
'Height': 2648,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4266/20484266/exterior_rear_driver-1774692778278.jpg',
'Width': 3531},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 939729,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_front_passenger-1774690463694.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 906538,
'Height': 2422,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4266/20484266/exterior_rear_passenger-1774690470309.jpg',
'Width': 3229},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1634623,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4266/20484266/interior_front_seats-1774691598800.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1228178,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4266/20484266/interior_rear_seats-1774691635283.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1227859,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4266/20484266/interior_dashboard-1774692877099.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1540886,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4266/20484266/interior_boot-1774691596978.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1475696,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691858312.jpg?ixlib=js-3.8.0&auto=format&s=f6622db8c129ff664736b67cb631ff60',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced35f07-4ca6-5961-bbca-9aed3f829d8d/ced35f07-4ca6-5961-bbca-9aed3f829d8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1408523,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4266/20484266/docs_service_history-1774691865107.jpg?ixlib=js-3.8.0&auto=format&s=01c7c2aab981daf46aee3b4eb0b7a5e6',
'Width': 2880}],
'price': 9464,
'price_includes_vat': False,
'registration_date': '2018-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga ST-LINE TDCI Auto',
'transmission': 'automatic',
'trim': 'ST-LINE TDCI Auto',
'vin': 'WF0AXXWPMAJY83768',
'year': 2018}
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484266%27 HTTP/1.1" 200 None
2026-03-29 20:22:10 [motorway.uk] INFO: Saving data for 20484266: {'created_time': 1774815730.803895, 'last_price_update_time': 1774815730.803906, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484266') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item ced35f07-4ca6-5961-bbca-9aed3f829d8d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_front_passenger-1774694783595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_passenger-1774694783595.jpg not downloaded yet
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f026d0>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Fexterior_front_driver-1774614429384.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_driver-1774614429384.jpg saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0ebd0>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9112%252F18989112%252Fdocs_service_history-1774615325070.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e2fb376e3e133b3019de5fd1689c2df') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9112/18989112/docs_service_history-1774615325070.jpg?ixlib=js-3.8.0&auto=format&s=3e2fb376e3e133b3019de5fd1689c2df saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce40110>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9112%252F18989112%252Finterior_dashboard-1774623641406.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9112/18989112/interior_dashboard-1774623641406.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0e050>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Finstrument_cluster-1774614969445.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/instrument_cluster-1774614969445.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_rear_passenger-1774694768469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_passenger-1774694768469.jpg not downloaded yet
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20355039.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2731%252F18332731%252Finterior_front_seats-1774695389997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2731/18332731/interior_front_seats-1774695389997.jpg not downloaded yet
2026-03-29 20:22:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2731%252F18332731%252Finterior_rear_seats-1774696666925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2731/18332731/interior_rear_seats-1774696666925.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Finterior_dashboard-1774695442854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/interior_dashboard-1774695442854.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Finstrument_cluster-1774695485493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/instrument_cluster-1774695485493.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2731%252F18332731%252Finterior_boot-1774695456367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2731/18332731/interior_boot-1774695456367.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2731%252F18332731%252Fdocs_service_history-1774695772193.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c8283f1bc1ff9752ce915705406b3eb%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2731/18332731/docs_service_history-1774695772193.jpg?ixlib=js-3.8.0&auto=format&s=8c8283f1bc1ff9752ce915705406b3eb not downloaded yet
2026-03-29 20:22:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e525093-7654-5e56-9494-52eede803f19 with identifier: 20355039
2026-03-29 20:22:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e525093-7654-5e56-9494-52eede803f19 with scrape type 1
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_front_driver-1774711515646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_front_driver-1774711515646.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_rear_driver-1774711476576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_driver-1774711476576.jpg not downloaded yet
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_passenger-1774614474811.jpg> (referer: None)
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_front_passenger-1774711438232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_front_passenger-1774711438232.jpg not downloaded yet
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_rear_driver-1774614445201.jpg> (referer: None)
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_rear_passenger-1774711418557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_passenger-1774711418557.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5039%252F20355039%252Finterior_front_seats-1774710470849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5039/20355039/interior_front_seats-1774710470849.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Finterior_rear_seats-1774711376617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/interior_rear_seats-1774711376617.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Finterior_dashboard-1774711364580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/interior_dashboard-1774711364580.jpg not downloaded yet
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9112/18989112/exterior_rear_passenger-1774623622418.jpg> (referer: None)
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Finterior_boot-1774711341519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/interior_boot-1774711341519.jpg not downloaded yet
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5039%252F20355039%252Fdocs_service_history-1774710726875.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De3ab0c01d7d5da91b804a63f7a1b0d68%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5039/20355039/docs_service_history-1774710726875.jpg?ixlib=js-3.8.0&auto=format&s=e3ab0c01d7d5da91b804a63f7a1b0d68 not downloaded yet
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ef410>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Fexterior_front_passenger-1774614474811.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_passenger-1774614474811.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c252c50>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9112%252F18989112%252Fexterior_rear_driver-1774614445201.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_rear_driver-1774614445201.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5039%252F20355039%252Fdamage_scratches-1774709974037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5039/20355039/damage_scratches-1774709974037.jpg not downloaded yet
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467839.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed820d0>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9112%252F18989112%252Fexterior_rear_passenger-1774623622418.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9112/18989112/exterior_rear_passenger-1774623622418.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9112/18989112/interior_front_seats-1774614883178.jpg> (referer: None)
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9112/18989112/interior_rear_seats-1774614899217.jpg> (referer: None)
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_passenger-1774694783595.jpg> (referer: None)
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_passenger-1774694768469.jpg> (referer: None)
2026-03-29 20:22:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08982308-6352-5471-b3cf-7e5a4c5e0306 with identifier: 20467839
2026-03-29 20:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08982308-6352-5471-b3cf-7e5a4c5e0306 with scrape type 1
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7839%252F20467839%252Fexterior_front_driver-1774784309552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_driver-1774784309552.jpg not downloaded yet
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7839%252F20467839%252Fexterior_rear_driver-1774784288030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7839/20467839/exterior_rear_driver-1774784288030.jpg not downloaded yet
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7839%252F20467839%252Fexterior_front_passenger-1774784271803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_passenger-1774784271803.jpg not downloaded yet
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7839%252F20467839%252Fexterior_rear_passenger-1774781815461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7839/20467839/exterior_rear_passenger-1774781815461.jpg not downloaded yet
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9112/18989112/interior_boot-1774614945141.jpg> (referer: None)
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7839%252F20467839%252Finterior_front_seats-1774782546774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7839/20467839/interior_front_seats-1774782546774.jpg not downloaded yet
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_driver-1774711476576.jpg> (referer: None)
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7839%252F20467839%252Finterior_rear_seats-1774782558752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7839/20467839/interior_rear_seats-1774782558752.jpg not downloaded yet
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e94e250>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9112%252F18989112%252Finterior_front_seats-1774614883178.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9112/18989112/interior_front_seats-1774614883178.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d240a90>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9112%252F18989112%252Finterior_rear_seats-1774614899217.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9112/18989112/interior_rear_seats-1774614899217.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce43e10>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_front_passenger-1774694783595.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_passenger-1774694783595.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa7450>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_rear_passenger-1774694768469.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_passenger-1774694768469.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7839%252F20467839%252Finterior_dashboard-1774782626680.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7839/20467839/interior_dashboard-1774782626680.jpg not downloaded yet
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7839%252F20467839%252Finstrument_cluster-1774782554733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7839/20467839/instrument_cluster-1774782554733.jpg not downloaded yet
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7839%252F20467839%252Finterior_boot-1774782447865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7839/20467839/interior_boot-1774782447865.jpg not downloaded yet
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce40e90>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9112%252F18989112%252Finterior_boot-1774614945141.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9112/18989112/interior_boot-1774614945141.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab
2026-03-29 20:22:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab, skipping ID generation
2026-03-29 20:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab with scrape type 1
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab sending to next pipeline
2026-03-29 20:22:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab, identifier: 18989112
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c19610>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_rear_driver-1774711476576.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_driver-1774711476576.jpg saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab with identifier: 18989112
2026-03-29 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab with identifier: 18989112
2026-03-29 20:22:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab with identifier: 18989112 to the API
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9112/18989112/interior_boot-1774614945141.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA21 GPF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18989112',
'listing': 'auction',
'location': 'Cheshire West and Chester Winsford',
'make': 'Audi',
'model': 'Q3',
'odometer': 32673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1333422,
'Height': 2335,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_driver-1774614429384.jpg',
'Width': 3113},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488389,
'Height': 2506,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_rear_driver-1774614445201.jpg',
'Width': 3341},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310368,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9112/18989112/exterior_front_passenger-1774614474811.jpg',
'Width': 3218},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041558,
'Height': 2791,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9112/18989112/exterior_rear_passenger-1774623622418.jpg',
'Width': 3721},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3565152,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9112/18989112/interior_front_seats-1774614883178.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2916096,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9112/18989112/interior_rear_seats-1774614899217.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2373286,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9112/18989112/interior_dashboard-1774623641406.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2613163,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9112/18989112/instrument_cluster-1774614969445.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4060599,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9112/18989112/interior_boot-1774614945141.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab/5e5d5b1c-09b3-5e8b-aa49-6401d379f1ab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561445,
'Height': 3305,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9112/18989112/docs_service_history-1774615325070.jpg?ixlib=js-3.8.0&auto=format&s=3e2fb376e3e133b3019de5fd1689c2df',
'Width': 2309}],
'price': 22147,
'price_includes_vat': False,
'registration_date': '2021-07-08',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S LN BLK ED 35 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S LN BLK ED 35 TFSI MHEV SA',
'vin': 'WAUZZZF37M1146153',
'year': 2021}
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718989112%27 HTTP/1.1" 200 None
2026-03-29 20:22:13 [motorway.uk] INFO: Saving data for 18989112: {'created_time': 1774815733.56229, 'last_price_update_time': 1774815733.5623, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18989112') HTTP/1.1" 204 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7839%252F20467839%252Fdocs_service_history-1774782677458.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db9b979d190136326e2f99da7a1355ce6%27 HTTP/1.1" 200 None
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7839/20467839/docs_service_history-1774782677458.jpg?ixlib=js-3.8.0&auto=format&s=b9b979d190136326e2f99da7a1355ce6 not downloaded yet
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4e525093-7654-5e56-9494-52eede803f19 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5039/20355039/interior_boot-1774711341519.jpg> (referer: None)
2026-03-29 20:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5039/20355039/damage_scratches-1774709974037.jpg> (referer: None)
2026-03-29 20:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5039/20355039/docs_service_history-1774710726875.jpg?ixlib=js-3.8.0&auto=format&s=e3ab0c01d7d5da91b804a63f7a1b0d68> (referer: None)
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba8910>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Finterior_boot-1774711341519.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/interior_boot-1774711341519.jpg saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e051910>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5039%252F20355039%252Fdamage_scratches-1774709974037.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5039/20355039/damage_scratches-1774709974037.jpg saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d011c90>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5039%252F20355039%252Fdocs_service_history-1774710726875.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De3ab0c01d7d5da91b804a63f7a1b0d68') HTTP/1.1" 204 0
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5039/20355039/docs_service_history-1774710726875.jpg?ixlib=js-3.8.0&auto=format&s=e3ab0c01d7d5da91b804a63f7a1b0d68 saved to cache
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_passenger-1774784271803.jpg> (referer: None)
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_driver-1774784309552.jpg> (referer: None)
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2acd90>
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7839%252F20467839%252Fexterior_front_passenger-1774784271803.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_passenger-1774784271803.jpg saved to cache
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c685210>
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7839%252F20467839%252Fexterior_front_driver-1774784309552.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_driver-1774784309552.jpg saved to cache
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7839/20467839/docs_service_history-1774782677458.jpg?ixlib=js-3.8.0&auto=format&s=b9b979d190136326e2f99da7a1355ce6> (referer: None)
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7839/20467839/exterior_rear_driver-1774784288030.jpg> (referer: None)
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5039/20355039/interior_dashboard-1774711364580.jpg> (referer: None)
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7839/20467839/interior_boot-1774782447865.jpg> (referer: None)
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7839/20467839/instrument_cluster-1774782554733.jpg> (referer: None)
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12c650>
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7839%252F20467839%252Fdocs_service_history-1774782677458.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db9b979d190136326e2f99da7a1355ce6') HTTP/1.1" 204 0
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7839/20467839/docs_service_history-1774782677458.jpg?ixlib=js-3.8.0&auto=format&s=b9b979d190136326e2f99da7a1355ce6 saved to cache
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7839/20467839/exterior_rear_passenger-1774781815461.jpg> (referer: None)
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7cbf50>
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7839%252F20467839%252Fexterior_rear_driver-1774784288030.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7839/20467839/exterior_rear_driver-1774784288030.jpg saved to cache
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d024750>
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Finterior_dashboard-1774711364580.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/interior_dashboard-1774711364580.jpg saved to cache
2026-03-29 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f05bd0>
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7839%252F20467839%252Finterior_boot-1774782447865.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7839/20467839/interior_boot-1774782447865.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf390>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7839%252F20467839%252Finstrument_cluster-1774782554733.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7839/20467839/instrument_cluster-1774782554733.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cade610>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7839%252F20467839%252Fexterior_rear_passenger-1774781815461.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7839/20467839/exterior_rear_passenger-1774781815461.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7839/20467839/interior_dashboard-1774782626680.jpg> (referer: None)
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7839/20467839/interior_front_seats-1774782546774.jpg> (referer: None)
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7839/20467839/interior_rear_seats-1774782558752.jpg> (referer: None)
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5039/20355039/interior_front_seats-1774710470849.jpg> (referer: None)
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e97b250>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7839%252F20467839%252Finterior_dashboard-1774782626680.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7839/20467839/interior_dashboard-1774782626680.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9d7d50>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7839%252F20467839%252Finterior_front_seats-1774782546774.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7839/20467839/interior_front_seats-1774782546774.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95d6d0>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7839%252F20467839%252Finterior_rear_seats-1774782558752.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7839/20467839/interior_rear_seats-1774782558752.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08982308-6352-5471-b3cf-7e5a4c5e0306
2026-03-29 20:22:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08982308-6352-5471-b3cf-7e5a4c5e0306, skipping ID generation
2026-03-29 20:22:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08982308-6352-5471-b3cf-7e5a4c5e0306 with scrape type 1
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08982308-6352-5471-b3cf-7e5a4c5e0306 sending to next pipeline
2026-03-29 20:22:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 08982308-6352-5471-b3cf-7e5a4c5e0306, identifier: 20467839
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2af5d0>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5039%252F20355039%252Finterior_front_seats-1774710470849.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5039/20355039/interior_front_seats-1774710470849.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 4e525093-7654-5e56-9494-52eede803f19 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 08982308-6352-5471-b3cf-7e5a4c5e0306 with identifier: 20467839
2026-03-29 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 08982308-6352-5471-b3cf-7e5a4c5e0306 with identifier: 20467839
2026-03-29 20:22:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 08982308-6352-5471-b3cf-7e5a4c5e0306 with identifier: 20467839 to the API
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7839/20467839/interior_rear_seats-1774782558752.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '08982308-6352-5471-b3cf-7e5a4c5e0306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YP73 RWO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20467839',
'listing': 'auction',
'location': 'Derbyshire Buxton',
'make': 'Audi',
'model': 'Q2',
'odometer': 25230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1748928,
'Height': 2241,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_driver-1774784309552.jpg',
'Width': 2988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663465,
'Height': 2104,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7839/20467839/exterior_rear_driver-1774784288030.jpg',
'Width': 2805},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1952504,
'Height': 2277,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7839/20467839/exterior_front_passenger-1774784271803.jpg',
'Width': 3036},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539969,
'Height': 2278,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7839/20467839/exterior_rear_passenger-1774781815461.jpg',
'Width': 3037},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2490650,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7839/20467839/interior_front_seats-1774782546774.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2375885,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7839/20467839/interior_rear_seats-1774782558752.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2130575,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7839/20467839/interior_dashboard-1774782626680.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1759332,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7839/20467839/instrument_cluster-1774782554733.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546689,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7839/20467839/interior_boot-1774782447865.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08982308-6352-5471-b3cf-7e5a4c5e0306/08982308-6352-5471-b3cf-7e5a4c5e0306_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1225693,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7839/20467839/docs_service_history-1774782677458.jpg?ixlib=js-3.8.0&auto=format&s=b9b979d190136326e2f99da7a1355ce6',
'Width': 3840}],
'price': 16153,
'price_includes_vat': False,
'registration_date': '2023-10-16',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q2 Sport 30 TFSI',
'transmission': 'manual',
'trim': 'Sport 30 TFSI',
'vin': 'WAUZZZGA0RA010807',
'year': 2023}
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467839%27 HTTP/1.1" 200 None
2026-03-29 20:22:16 [motorway.uk] INFO: Saving data for 20467839: {'created_time': 1774815736.39713, 'last_price_update_time': 1774815736.397142, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20467839') HTTP/1.1" 204 0
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5039/20355039/exterior_front_passenger-1774711438232.jpg> (referer: None)
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2731/18332731/docs_service_history-1774695772193.jpg?ixlib=js-3.8.0&auto=format&s=8c8283f1bc1ff9752ce915705406b3eb> (referer: None)
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_passenger-1774711418557.jpg> (referer: None)
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2731/18332731/interior_dashboard-1774695442854.jpg> (referer: None)
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2731/18332731/instrument_cluster-1774695485493.jpg> (referer: None)
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2731/18332731/interior_boot-1774695456367.jpg> (referer: None)
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9f1290>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_front_passenger-1774711438232.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_front_passenger-1774711438232.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb38f50>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2731%252F18332731%252Fdocs_service_history-1774695772193.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c8283f1bc1ff9752ce915705406b3eb') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2731/18332731/docs_service_history-1774695772193.jpg?ixlib=js-3.8.0&auto=format&s=8c8283f1bc1ff9752ce915705406b3eb saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15cb10>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5039%252F20355039%252Fexterior_rear_passenger-1774711418557.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_passenger-1774711418557.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e525093-7654-5e56-9494-52eede803f19
2026-03-29 20:22:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e525093-7654-5e56-9494-52eede803f19, skipping ID generation
2026-03-29 20:22:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e525093-7654-5e56-9494-52eede803f19 with scrape type 1
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e525093-7654-5e56-9494-52eede803f19 sending to next pipeline
2026-03-29 20:22:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4e525093-7654-5e56-9494-52eede803f19, identifier: 20355039
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c2e690>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Finterior_dashboard-1774695442854.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/interior_dashboard-1774695442854.jpg saved to cache
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c10690>
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Finstrument_cluster-1774695485493.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/instrument_cluster-1774695485493.jpg saved to cache
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec29790>
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2731%252F18332731%252Finterior_boot-1774695456367.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2731/18332731/interior_boot-1774695456367.jpg saved to cache
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4e525093-7654-5e56-9494-52eede803f19 with identifier: 20355039
2026-03-29 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4e525093-7654-5e56-9494-52eede803f19 with identifier: 20355039
2026-03-29 20:22:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4e525093-7654-5e56-9494-52eede803f19 with identifier: 20355039 to the API
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_passenger-1774711418557.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4e525093-7654-5e56-9494-52eede803f19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU22 NVP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20355039',
'listing': 'auction',
'location': 'East Sussex Newhaven',
'make': 'MG',
'model': 'ZS',
'odometer': 22906,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1873245,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_driver-1774711476576.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1957908,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5039/20355039/exterior_front_passenger-1774711438232.jpg',
'Width': 3435},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1816263,
'Height': 2443,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5039/20355039/exterior_rear_passenger-1774711418557.jpg',
'Width': 3257},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3044702,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5039/20355039/interior_front_seats-1774710470849.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5039/20355039/interior_dashboard-1774711364580.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848247,
'Height': 2239,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5039/20355039/interior_boot-1774711341519.jpg',
'Width': 2985},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3456248,
'Height': 2845,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5039/20355039/docs_service_history-1774710726875.jpg?ixlib=js-3.8.0&auto=format&s=e3ab0c01d7d5da91b804a63f7a1b0d68',
'Width': 1994},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e525093-7654-5e56-9494-52eede803f19/4e525093-7654-5e56-9494-52eede803f19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2754868,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5039/20355039/damage_scratches-1774709974037.jpg',
'Width': 4032}],
'price': 9600,
'price_includes_vat': False,
'registration_date': '2022-03-26',
'seats_number': None,
'seller_name': None,
'title': 'MG ZS Exclusive T-GDi',
'transmission': 'manual',
'trim': 'Exclusive T-GDi',
'vin': 'LSJW74C99MZ239649',
'year': 2022}
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720355039%27 HTTP/1.1" 200 None
2026-03-29 20:22:17 [motorway.uk] INFO: Saving data for 20355039: {'created_time': 1774815737.726088, 'last_price_update_time': 1774815737.726104, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20355039') HTTP/1.1" 204 0
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/2939803.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_driver-1774694750834.jpg> (referer: None)
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6366/2726366/interior_dashboard-1774707069676.jpg> (referer: None)
2026-03-29 20:22:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2731/18332731/interior_rear_seats-1774696666925.jpg> (referer: None)
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6366/2726366/interior_rear_seats-1774705281101.jpg> (referer: None)
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2731/18332731/interior_front_seats-1774695389997.jpg> (referer: None)
2026-03-29 20:22:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd3e66a6-d639-5198-aff7-330d19a5ca02 with identifier: 2939803
2026-03-29 20:22:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd3e66a6-d639-5198-aff7-330d19a5ca02 with scrape type 1
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Fexterior_front_driver-1774626142376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_front_driver-1774626142376.jpg not downloaded yet
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Fexterior_rear_driver-1774626158964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_rear_driver-1774626158964.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Fexterior_front_passenger-1774626184389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_front_passenger-1774626184389.jpg not downloaded yet
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15e250>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_rear_driver-1774694750834.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_driver-1774694750834.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e03c750>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6366%252F2726366%252Finterior_dashboard-1774707069676.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6366/2726366/interior_dashboard-1774707069676.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea66e50>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2731%252F18332731%252Finterior_rear_seats-1774696666925.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2731/18332731/interior_rear_seats-1774696666925.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea64b10>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6366%252F2726366%252Finterior_rear_seats-1774705281101.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6366/2726366/interior_rear_seats-1774705281101.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e086890>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2731%252F18332731%252Finterior_front_seats-1774695389997.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2731/18332731/interior_front_seats-1774695389997.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Fexterior_rear_passenger-1774626174196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_rear_passenger-1774626174196.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9803%252F2939803%252Finterior_front_seats-1774626548784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9803/2939803/interior_front_seats-1774626548784.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9803%252F2939803%252Finterior_rear_seats-1774626569284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9803/2939803/interior_rear_seats-1774626569284.jpg not downloaded yet
2026-03-29 20:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_driver-1774694722129.jpg> (referer: None)
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9803%252F2939803%252Finterior_dashboard-1774628349077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9803/2939803/interior_dashboard-1774628349077.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Finstrument_cluster-1774626656421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/instrument_cluster-1774626656421.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9803%252F2939803%252Finterior_boot-1774626617690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9803/2939803/interior_boot-1774626617690.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9803%252F2939803%252Fdocs_service_history-1774626839528.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D72c2eed64b341798af99cc45738877da%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9803/2939803/docs_service_history-1774626839528.jpg?ixlib=js-3.8.0&auto=format&s=72c2eed64b341798af99cc45738877da not downloaded yet
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc15a3ffd0>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2731%252F18332731%252Fexterior_front_driver-1774694722129.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_driver-1774694722129.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee4d2618-29c4-5668-ac5d-f87a2c24e130
2026-03-29 20:22:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee4d2618-29c4-5668-ac5d-f87a2c24e130, skipping ID generation
2026-03-29 20:22:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4d2618-29c4-5668-ac5d-f87a2c24e130 with scrape type 1
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee4d2618-29c4-5668-ac5d-f87a2c24e130 sending to next pipeline
2026-03-29 20:22:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ee4d2618-29c4-5668-ac5d-f87a2c24e130, identifier: 18332731
2026-03-29 20:22:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ee4d2618-29c4-5668-ac5d-f87a2c24e130 with identifier: 18332731
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red+%26+Black HTTP/1.1" 200 None
2026-03-29 20:22:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:22:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ee4d2618-29c4-5668-ac5d-f87a2c24e130 with identifier: 18332731
2026-03-29 20:22:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ee4d2618-29c4-5668-ac5d-f87a2c24e130 with identifier: 18332731 to the API
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_driver-1774694722129.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ee4d2618-29c4-5668-ac5d-f87a2c24e130',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY18 LSD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18332731',
'listing': 'auction',
'location': 'Warwickshire Rugby',
'make': 'Jeep',
'model': 'Compass',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261610,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_driver-1774694722129.jpg',
'Width': 2983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 900837,
'Height': 1977,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_driver-1774694750834.jpg',
'Width': 2636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1104442,
'Height': 1998,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_front_passenger-1774694783595.jpg',
'Width': 2664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1089537,
'Height': 2164,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2731/18332731/exterior_rear_passenger-1774694768469.jpg',
'Width': 2885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3234191,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2731/18332731/interior_front_seats-1774695389997.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2788735,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2731/18332731/interior_rear_seats-1774696666925.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1722934,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2731/18332731/interior_dashboard-1774695442854.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2556039,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2731/18332731/instrument_cluster-1774695485493.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3410245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2731/18332731/interior_boot-1774695456367.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee4d2618-29c4-5668-ac5d-f87a2c24e130/ee4d2618-29c4-5668-ac5d-f87a2c24e130_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791276,
'Height': 2051,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2731/18332731/docs_service_history-1774695772193.jpg?ixlib=js-3.8.0&auto=format&s=8c8283f1bc1ff9752ce915705406b3eb',
'Width': 3548}],
'price': 7817,
'price_includes_vat': False,
'registration_date': '2018-03-02',
'seats_number': None,
'seller_name': None,
'title': 'Jeep Compass Limited Multijet II A',
'transmission': 'automatic',
'trim': 'Limited Multijet II A',
'vin': 'MCANJRCY7JFA17772',
'year': 2018}
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718332731%27 HTTP/1.1" 200 None
2026-03-29 20:22:19 [motorway.uk] INFO: Saving data for 18332731: {'created_time': 1774815739.619074, 'last_price_update_time': 1774815739.619085, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18332731') HTTP/1.1" 204 0
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 74936303-29ee-5997-9803-a9fb0c850e51 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6366/2726366/interior_front_seats-1774707950555.jpg> (referer: None)
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_passenger-1774704838810.jpg> (referer: None)
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_driver-1774704791609.jpg> (referer: None)
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_rear_passenger-1774704825097.jpg> (referer: None)
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9803/2939803/interior_front_seats-1774626548784.jpg> (referer: None)
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021750>
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6366%252F2726366%252Finterior_front_seats-1774707950555.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6366/2726366/interior_front_seats-1774707950555.jpg saved to cache
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea64850>
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_front_passenger-1774704838810.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_passenger-1774704838810.jpg saved to cache
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc154701d0>
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_front_driver-1774704791609.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_driver-1774704791609.jpg saved to cache
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d18ebd0>
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6366%252F2726366%252Fexterior_rear_passenger-1774704825097.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_rear_passenger-1774704825097.jpg saved to cache
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74936303-29ee-5997-9803-a9fb0c850e51
2026-03-29 20:22:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74936303-29ee-5997-9803-a9fb0c850e51, skipping ID generation
2026-03-29 20:22:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74936303-29ee-5997-9803-a9fb0c850e51 with scrape type 1
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74936303-29ee-5997-9803-a9fb0c850e51 sending to next pipeline
2026-03-29 20:22:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 74936303-29ee-5997-9803-a9fb0c850e51, identifier: 2726366
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021f50>
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9803%252F2939803%252Finterior_front_seats-1774626548784.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9803/2939803/interior_front_seats-1774626548784.jpg saved to cache
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 74936303-29ee-5997-9803-a9fb0c850e51 with identifier: 2726366
2026-03-29 20:22:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 74936303-29ee-5997-9803-a9fb0c850e51 with identifier: 2726366
2026-03-29 20:22:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 74936303-29ee-5997-9803-a9fb0c850e51 with identifier: 2726366 to the API
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_rear_passenger-1774704825097.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '74936303-29ee-5997-9803-a9fb0c850e51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RK22 KYP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/2726366',
'listing': 'auction',
'location': 'Somerset Shepton Mallet',
'make': 'Audi',
'model': 'Q3',
'odometer': 35936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1614080,
'Height': 2644,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_driver-1774704791609.jpg',
'Width': 3525},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458646,
'Height': 2351,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_front_passenger-1774704838810.jpg',
'Width': 3135},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1958978,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6366/2726366/exterior_rear_passenger-1774704825097.jpg',
'Width': 3671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1982778,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6366/2726366/interior_front_seats-1774707950555.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2943721,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6366/2726366/interior_rear_seats-1774705281101.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2209719,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6366/2726366/interior_dashboard-1774707069676.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3616538,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6366/2726366/interior_boot-1774705322621.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859477,
'Height': 3132,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6366/2726366/docs_service_history-1774705720664.jpg?ixlib=js-3.8.0&auto=format&s=575124a258e938c5e6ca067efc606728',
'Width': 2285},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74936303-29ee-5997-9803-a9fb0c850e51/74936303-29ee-5997-9803-a9fb0c850e51_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891573,
'Height': 2879,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6366/2726366/docs_service_history-1774707668065.jpg?ixlib=js-3.8.0&auto=format&s=fdff057f9107329892b0c3ddec12f3b9',
'Width': 2159}],
'price': 21258,
'price_includes_vat': False,
'registration_date': '2022-03-10',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S Line 35 TFSI MHEV S-',
'transmission': 'automatic',
'trim': 'S Line 35 TFSI MHEV S-',
'vin': 'WAUZZZF3XN1068601',
'year': 2022}
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272726366%27 HTTP/1.1" 200 None
2026-03-29 20:22:20 [motorway.uk] INFO: Saving data for 2726366: {'created_time': 1774815740.762676, 'last_price_update_time': 1774815740.762686, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='2726366') HTTP/1.1" 204 0
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item cd3e66a6-d639-5198-aff7-330d19a5ca02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item cd3e66a6-d639-5198-aff7-330d19a5ca02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item cd3e66a6-d639-5198-aff7-330d19a5ca02 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9803/2939803/interior_boot-1774626617690.jpg> (referer: None)
2026-03-29 20:22:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9803/2939803/docs_service_history-1774626839528.jpg?ixlib=js-3.8.0&auto=format&s=72c2eed64b341798af99cc45738877da> (referer: None)
2026-03-29 20:22:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_front_driver-1774626142376.jpg> (referer: None)
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef5950>
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9803%252F2939803%252Finterior_boot-1774626617690.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9803/2939803/interior_boot-1774626617690.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d584450>
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9803%252F2939803%252Fdocs_service_history-1774626839528.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D72c2eed64b341798af99cc45738877da') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9803/2939803/docs_service_history-1774626839528.jpg?ixlib=js-3.8.0&auto=format&s=72c2eed64b341798af99cc45738877da saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15af10>
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Fexterior_front_driver-1774626142376.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_front_driver-1774626142376.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9803/2939803/interior_dashboard-1774628349077.jpg> (referer: None)
2026-03-29 20:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9803/2939803/instrument_cluster-1774626656421.jpg> (referer: None)
2026-03-29 20:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9803/2939803/interior_rear_seats-1774626569284.jpg> (referer: None)
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c214f90>
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9803%252F2939803%252Finterior_dashboard-1774628349077.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9803/2939803/interior_dashboard-1774628349077.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14ee8150>
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9803%252F2939803%252Finstrument_cluster-1774626656421.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9803/2939803/instrument_cluster-1774626656421.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13a090>
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9803%252F2939803%252Finterior_rear_seats-1774626569284.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9803/2939803/interior_rear_seats-1774626569284.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd3e66a6-d639-5198-aff7-330d19a5ca02
2026-03-29 20:22:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd3e66a6-d639-5198-aff7-330d19a5ca02, skipping ID generation
2026-03-29 20:22:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd3e66a6-d639-5198-aff7-330d19a5ca02 with scrape type 1
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd3e66a6-d639-5198-aff7-330d19a5ca02 sending to next pipeline
2026-03-29 20:22:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cd3e66a6-d639-5198-aff7-330d19a5ca02, identifier: 2939803
2026-03-29 20:22:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cd3e66a6-d639-5198-aff7-330d19a5ca02 with identifier: 2939803
2026-03-29 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cd3e66a6-d639-5198-aff7-330d19a5ca02 with identifier: 2939803
2026-03-29 20:22:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cd3e66a6-d639-5198-aff7-330d19a5ca02 with identifier: 2939803 to the API
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9803/2939803/interior_rear_seats-1774626569284.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cd3e66a6-d639-5198-aff7-330d19a5ca02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YJ18 MYN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/2939803',
'listing': 'auction',
'location': 'Derbyshire Chesterfield',
'make': 'Mercedes',
'model': 'Vito',
'odometer': 127255,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478349,
'Height': 2939,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9803/2939803/exterior_front_driver-1774626142376.jpg',
'Width': 3918},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4236574,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9803/2939803/interior_front_seats-1774626548784.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4959046,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9803/2939803/interior_rear_seats-1774626569284.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3051107,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9803/2939803/interior_dashboard-1774628349077.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2179764,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9803/2939803/instrument_cluster-1774626656421.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3342014,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9803/2939803/interior_boot-1774626617690.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd3e66a6-d639-5198-aff7-330d19a5ca02/cd3e66a6-d639-5198-aff7-330d19a5ca02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2370051,
'Height': 2517,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9803/2939803/docs_service_history-1774626839528.jpg?ixlib=js-3.8.0&auto=format&s=72c2eed64b341798af99cc45738877da',
'Width': 1773}],
'price': 12814,
'price_includes_vat': False,
'registration_date': '2018-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes Vito 119 Bluetec Auto',
'transmission': 'automatic',
'trim': '119 Bluetec Auto',
'vin': 'WDF44770523409072',
'year': 2018}
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272939803%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [motorway.uk] INFO: Saving data for 2939803: {'created_time': 1774815742.223627, 'last_price_update_time': 1774815742.223637, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='2939803') HTTP/1.1" 204 0
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0094/20390094/docs_service_history-1774697984118.jpg?ixlib=js-3.8.0&auto=format&s=5cd43984773af2c510a9b4ba3092fc93> (referer: None)
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0094/20390094/interior_boot-1774697718926.jpg> (referer: None)
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c65a010>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0094%252F20390094%252Fdocs_service_history-1774697984118.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5cd43984773af2c510a9b4ba3092fc93') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0094/20390094/docs_service_history-1774697984118.jpg?ixlib=js-3.8.0&auto=format&s=5cd43984773af2c510a9b4ba3092fc93 saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d069e10>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Finterior_boot-1774697718926.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/interior_boot-1774697718926.jpg saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488132.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_passenger-1774698874587.jpg> (referer: None)
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0094/20390094/interior_dashboard-1774698754453.jpg> (referer: None)
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0094/20390094/interior_rear_seats-1774697720501.jpg> (referer: None)
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0094/20390094/interior_front_seats-1774697716257.jpg> (referer: None)
2026-03-29 20:22:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6594c694-28e2-5ea4-a703-7e055cb8d345 with identifier: 20488132
2026-03-29 20:22:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6594c694-28e2-5ea4-a703-7e055cb8d345 with scrape type 1
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_front_driver-1774705171450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_driver-1774705171450.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_rear_driver-1774705183814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_driver-1774705183814.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_front_passenger-1774705202587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_passenger-1774705202587.jpg not downloaded yet
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ce250>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0094%252F20390094%252Fexterior_rear_passenger-1774698874587.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_passenger-1774698874587.jpg saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e96b910>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0094%252F20390094%252Finterior_dashboard-1774698754453.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0094/20390094/interior_dashboard-1774698754453.jpg saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf01450>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Finterior_rear_seats-1774697720501.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/interior_rear_seats-1774697720501.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_rear_passenger-1774705192606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_passenger-1774705192606.jpg not downloaded yet
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9dae50>
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0094%252F20390094%252Finterior_front_seats-1774697716257.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0094/20390094/interior_front_seats-1774697716257.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8132%252F20488132%252Finterior_front_seats-1774708117034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8132/20488132/interior_front_seats-1774708117034.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8132%252F20488132%252Finterior_rear_seats-1774708134146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8132/20488132/interior_rear_seats-1774708134146.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Finterior_dashboard-1774705505795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/interior_dashboard-1774705505795.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8132%252F20488132%252Finterior_boot-1774705461308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8132/20488132/interior_boot-1774705461308.jpg not downloaded yet
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_driver-1774697135588.jpg> (referer: None)
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8132%252F20488132%252Fdocs_service_history-1774705588501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df42098f9f5740ed9b53d30f63c47ed14%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588501.jpg?ixlib=js-3.8.0&auto=format&s=f42098f9f5740ed9b53d30f63c47ed14 not downloaded yet
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18285367.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8132%252F20488132%252Fdocs_service_history-1774705588619.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5b1262270b1bd481968447b1694d7540%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588619.jpg?ixlib=js-3.8.0&auto=format&s=5b1262270b1bd481968447b1694d7540 not downloaded yet
2026-03-29 20:22:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_passenger-1774697132424.jpg> (referer: None)
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_driver-1774698778533.jpg> (referer: None)
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c632610>
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0094%252F20390094%252Fexterior_front_driver-1774697135588.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_driver-1774697135588.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8b8e21-dc38-5267-8871-f52d63d9cd2b with identifier: 18285367
2026-03-29 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b with scrape type 1
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_front_driver-1774704668912.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_driver-1774704668912.jpeg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_rear_driver-1774704735643.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_driver-1774704735643.jpeg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_front_passenger-1774704680238.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_passenger-1774704680238.jpeg not downloaded yet
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c630750>
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0094%252F20390094%252Fexterior_front_passenger-1774697132424.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_passenger-1774697132424.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d069190>
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0094%252F20390094%252Fexterior_rear_driver-1774698778533.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_driver-1774698778533.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd109f30-d155-5dc0-8265-17142de84af3
2026-03-29 20:22:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd109f30-d155-5dc0-8265-17142de84af3, skipping ID generation
2026-03-29 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd109f30-d155-5dc0-8265-17142de84af3 with scrape type 1
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd109f30-d155-5dc0-8265-17142de84af3 sending to next pipeline
2026-03-29 20:22:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bd109f30-d155-5dc0-8265-17142de84af3, identifier: 20390094
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_rear_passenger-1774704722709.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_passenger-1774704722709.jpeg not downloaded yet
2026-03-29 20:22:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bd109f30-d155-5dc0-8265-17142de84af3 with identifier: 20390094
2026-03-29 20:22:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bd109f30-d155-5dc0-8265-17142de84af3 with identifier: 20390094
2026-03-29 20:22:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bd109f30-d155-5dc0-8265-17142de84af3 with identifier: 20390094 to the API
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_driver-1774698778533.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'bd109f30-d155-5dc0-8265-17142de84af3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA22 RZH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20390094',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Peugeot',
'model': '2008',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726697,
'Height': 1712,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_driver-1774697135588.jpg',
'Width': 2282},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1584878,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_driver-1774698778533.jpg',
'Width': 3155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866779,
'Height': 1850,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0094/20390094/exterior_front_passenger-1774697132424.jpg',
'Width': 2467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1640663,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0094/20390094/exterior_rear_passenger-1774698874587.jpg',
'Width': 3255},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1527052,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0094/20390094/interior_front_seats-1774697716257.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505243,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0094/20390094/interior_rear_seats-1774697720501.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1280045,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0094/20390094/interior_dashboard-1774698754453.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173264,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0094/20390094/interior_boot-1774697718926.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1063233,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0094/20390094/docs_service_history-1774697984118.jpg?ixlib=js-3.8.0&auto=format&s=5cd43984773af2c510a9b4ba3092fc93',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd109f30-d155-5dc0-8265-17142de84af3/bd109f30-d155-5dc0-8265-17142de84af3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1590861,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0094/20390094/damage_scratches-1774697222607.jpg',
'Width': 3840}],
'price': 9110,
'price_includes_vat': False,
'registration_date': '2022-06-24',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 2008 GT Premium EV',
'transmission': 'automatic',
'trim': 'GT Premium EV',
'vin': 'VR3UKZKXZNJ657635',
'year': 2022}
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720390094%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [motorway.uk] INFO: Saving data for 20390094: {'created_time': 1774815744.177993, 'last_price_update_time': 1774815744.178005, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20390094') HTTP/1.1" 204 0
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588619.jpg?ixlib=js-3.8.0&auto=format&s=5b1262270b1bd481968447b1694d7540> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588501.jpg?ixlib=js-3.8.0&auto=format&s=f42098f9f5740ed9b53d30f63c47ed14> (referer: None)
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18285367%252Finterior_front_seats-1774704966858.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18285367/interior_front_seats-1774704966858.jpeg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18285367%252Finterior_rear_seats-1774704831409.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18285367/interior_rear_seats-1774704831409.jpeg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Finterior_dashboard-1774705029153.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/interior_dashboard-1774705029153.jpeg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Finstrument_cluster-1774704925650.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/instrument_cluster-1774704925650.jpeg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18285367%252Finterior_boot-1774704935470.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18285367/interior_boot-1774704935470.jpeg not downloaded yet
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea67f10>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8132%252F20488132%252Fdocs_service_history-1774705588619.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5b1262270b1bd481968447b1694d7540') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588619.jpg?ixlib=js-3.8.0&auto=format&s=5b1262270b1bd481968447b1694d7540 saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02e2d0>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8132%252F20488132%252Fdocs_service_history-1774705588501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df42098f9f5740ed9b53d30f63c47ed14') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588501.jpg?ixlib=js-3.8.0&auto=format&s=f42098f9f5740ed9b53d30f63c47ed14 saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F5367%252F18285367%252F18285367-docs_service_history-default-1769434257523.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D94efbc9040e27acd2abb70a4f8c43d5f%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/5367/18285367/18285367-docs_service_history-default-1769434257523.jpeg?ixlib=js-3.8.0&auto=format&s=94efbc9040e27acd2abb70a4f8c43d5f not downloaded yet
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8132/20488132/interior_dashboard-1774705505795.jpg> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_passenger-1774705192606.jpg> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8132/20488132/interior_boot-1774705461308.jpg> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_passenger-1774704722709.jpeg> (referer: None)
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d268310>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Finterior_dashboard-1774705505795.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/interior_dashboard-1774705505795.jpg saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ba950>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_rear_passenger-1774705192606.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_passenger-1774705192606.jpg saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec83290>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8132%252F20488132%252Finterior_boot-1774705461308.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8132/20488132/interior_boot-1774705461308.jpg saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c20e650>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_rear_passenger-1774704722709.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_passenger-1774704722709.jpeg saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/5367/18285367/18285367-docs_service_history-default-1769434257523.jpeg?ixlib=js-3.8.0&auto=format&s=94efbc9040e27acd2abb70a4f8c43d5f> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_passenger-1774704680238.jpeg> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5367/18285367/interior_boot-1774704935470.jpeg> (referer: None)
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x12c{\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\\\xf3\x00\x12A\xaa\x00\x00\x00\x00'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d027d10>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F5367%252F18285367%252F18285367-docs_service_history-default-1769434257523.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D94efbc9040e27acd2abb70a4f8c43d5f') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/5367/18285367/18285367-docs_service_history-default-1769434257523.jpeg?ixlib=js-3.8.0&auto=format&s=94efbc9040e27acd2abb70a4f8c43d5f saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e02c390>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_front_passenger-1774704680238.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_passenger-1774704680238.jpeg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,\xd7\x8f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xed=\x00,\xcd\r\x00\x00\x00\x00'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d26a3d0>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18285367%252Finterior_boot-1774704935470.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18285367/interior_boot-1774704935470.jpeg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5367/18285367/interior_rear_seats-1774704831409.jpeg> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18285367/interior_dashboard-1774705029153.jpeg> (referer: None)
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1d\xe7{\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xdf\x13\x00\x1d\xdc\xf9\x00\x00\x00\x00'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b0ed0>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18285367%252Finterior_rear_seats-1774704831409.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18285367/interior_rear_seats-1774704831409.jpeg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002p.\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x046\r\x002e\xac\x00\x00\x00\x00'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54c210>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Finterior_dashboard-1774705029153.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/interior_dashboard-1774705029153.jpeg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5367/18285367/interior_front_seats-1774704966858.jpeg> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_driver-1774704735643.jpeg> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18285367/instrument_cluster-1774704925650.jpeg> (referer: None)
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/\xe6\x96\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x91\xf9\x00/\xdc\x14\x00\x00\x00\x00'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d159fd0>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18285367%252Finterior_front_seats-1774704966858.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18285367/interior_front_seats-1774704966858.jpeg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_driver-1774704668912.jpeg> (referer: None)
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb3bf50>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_rear_driver-1774704735643.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_driver-1774704735643.jpeg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:26 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:26 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:26 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1fwq\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02E\x82\x00\x1fl\xef\x00\x00\x00\x00'
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadc290>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Finstrument_cluster-1774704925650.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/instrument_cluster-1774704925650.jpeg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0bbdd0>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18285367%252Fexterior_front_driver-1774704668912.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_driver-1774704668912.jpeg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b
2026-03-29 20:22:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac8b8e21-dc38-5267-8871-f52d63d9cd2b, skipping ID generation
2026-03-29 20:22:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b with scrape type 1
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac8b8e21-dc38-5267-8871-f52d63d9cd2b sending to next pipeline
2026-03-29 20:22:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ac8b8e21-dc38-5267-8871-f52d63d9cd2b, identifier: 18285367
2026-03-29 20:22:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ac8b8e21-dc38-5267-8871-f52d63d9cd2b with identifier: 18285367
2026-03-29 20:22:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ac8b8e21-dc38-5267-8871-f52d63d9cd2b with identifier: 18285367
2026-03-29 20:22:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ac8b8e21-dc38-5267-8871-f52d63d9cd2b with identifier: 18285367 to the API
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_driver-1774704668912.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '4.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ac8b8e21-dc38-5267-8871-f52d63d9cd2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'T4 FFD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18285367',
'listing': 'auction',
'location': 'Surrey Chertsey',
'make': 'BMW',
'model': '6 Series',
'odometer': 39562,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1914238,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_driver-1774704668912.jpeg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2339121,
'Height': 2770,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_driver-1774704735643.jpeg',
'Width': 3693},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340178,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_front_passenger-1774704680238.jpeg',
'Width': 3766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2218483,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18285367/exterior_rear_passenger-1774704722709.jpeg',
'Width': 3507},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3307663,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5367/18285367/interior_front_seats-1774704966858.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2082446,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5367/18285367/interior_rear_seats-1774704831409.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3581499,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18285367/interior_dashboard-1774705029153.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2211059,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18285367/instrument_cluster-1774704925650.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3130572,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5367/18285367/interior_boot-1774704935470.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b8e21-dc38-5267-8871-f52d63d9cd2b/ac8b8e21-dc38-5267-8871-f52d63d9cd2b_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1425518,
'Height': 2142,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/5367/18285367/18285367-docs_service_history-default-1769434257523.jpeg?ixlib=js-3.8.0&auto=format&s=94efbc9040e27acd2abb70a4f8c43d5f',
'Width': 2856}],
'price': 16928,
'price_includes_vat': False,
'registration_date': '2016-10-20',
'seats_number': None,
'seller_name': None,
'title': 'BMW 650I M Sport Auto',
'transmission': 'automatic',
'trim': '650I M Sport Auto',
'vin': 'WBA6D42010GS38642',
'year': 2016}
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718285367%27 HTTP/1.1" 200 None
2026-03-29 20:22:26 [motorway.uk] INFO: Saving data for 18285367: {'created_time': 1774815746.942064, 'last_price_update_time': 1774815746.942075, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18285367') HTTP/1.1" 204 0
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8132/20488132/interior_rear_seats-1774708134146.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8132/20488132/interior_front_seats-1774708117034.jpg> (referer: None)
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9f2410>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8132%252F20488132%252Finterior_rear_seats-1774708134146.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8132/20488132/interior_rear_seats-1774708134146.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d026d10>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8132%252F20488132%252Finterior_front_seats-1774708117034.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8132/20488132/interior_front_seats-1774708117034.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_driver-1774705183814.jpg> (referer: None)
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_passenger-1774705202587.jpg> (referer: None)
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9d47d0>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_rear_driver-1774705183814.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_driver-1774705183814.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b2950>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_front_passenger-1774705202587.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_passenger-1774705202587.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_driver-1774705171450.jpg> (referer: None)
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b9f10>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8132%252F20488132%252Fexterior_front_driver-1774705171450.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_driver-1774705171450.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6594c694-28e2-5ea4-a703-7e055cb8d345
2026-03-29 20:22:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6594c694-28e2-5ea4-a703-7e055cb8d345, skipping ID generation
2026-03-29 20:22:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6594c694-28e2-5ea4-a703-7e055cb8d345 with scrape type 1
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6594c694-28e2-5ea4-a703-7e055cb8d345 sending to next pipeline
2026-03-29 20:22:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6594c694-28e2-5ea4-a703-7e055cb8d345, identifier: 20488132
2026-03-29 20:22:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6594c694-28e2-5ea4-a703-7e055cb8d345 with identifier: 20488132
2026-03-29 20:22:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6594c694-28e2-5ea4-a703-7e055cb8d345 with identifier: 20488132
2026-03-29 20:22:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6594c694-28e2-5ea4-a703-7e055cb8d345 with identifier: 20488132 to the API
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_driver-1774705171450.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6594c694-28e2-5ea4-a703-7e055cb8d345',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'XG21 GEO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488132',
'listing': 'auction',
'location': 'Essex Ingatestone',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 33200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1178646,
'Height': 2255,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_driver-1774705171450.jpg',
'Width': 3007},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1031302,
'Height': 2445,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_driver-1774705183814.jpg',
'Width': 3260},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1416406,
'Height': 2511,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_front_passenger-1774705202587.jpg',
'Width': 3348},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2155783,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8132/20488132/exterior_rear_passenger-1774705192606.jpg',
'Width': 3854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2917306,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8132/20488132/interior_front_seats-1774708117034.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3578898,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8132/20488132/interior_rear_seats-1774708134146.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1365310,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8132/20488132/interior_dashboard-1774705505795.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3508022,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8132/20488132/interior_boot-1774705461308.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102762,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588501.jpg?ixlib=js-3.8.0&auto=format&s=f42098f9f5740ed9b53d30f63c47ed14',
'Width': 596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6594c694-28e2-5ea4-a703-7e055cb8d345/6594c694-28e2-5ea4-a703-7e055cb8d345_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85019,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8132/20488132/docs_service_history-1774705588619.jpg?ixlib=js-3.8.0&auto=format&s=5b1262270b1bd481968447b1694d7540',
'Width': 596}],
'price': 21301,
'price_includes_vat': False,
'registration_date': '2022-03-09',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 180 AMG Line Premium + A',
'transmission': 'automatic',
'trim': 'CLA 180 AMG Line Premium + A',
'vin': 'W1K1183842N288388',
'year': 2022}
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488132%27 HTTP/1.1" 200 None
2026-03-29 20:22:28 [motorway.uk] INFO: Saving data for 20488132: {'created_time': 1774815748.387898, 'last_price_update_time': 1774815748.387906, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488132') HTTP/1.1" 204 0
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8961/20408961/interior_dashboard-1774704651600.jpg> (referer: None)
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8961/20408961/interior_boot-1774704090928.jpg> (referer: None)
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8961/20408961/instrument_cluster-1774702355675.jpg> (referer: None)
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21e250>
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8961%252F20408961%252Finterior_dashboard-1774704651600.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8961/20408961/interior_dashboard-1774704651600.jpg saved to cache
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19443439.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x10\x12\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x8c\r\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'SM-A715F\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x03\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 210 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 218 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 176 - value: b'A715FXXSBDXB1\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 190 - value: b'2026:03:28 13:08:00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe2\x00\x00\x00'
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b2110>
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8961%252F20408961%252Finterior_boot-1774704090928.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8961/20408961/interior_boot-1774704090928.jpg saved to cache
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x10\x12\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x8c\r\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'SM-A715F\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x03\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 210 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 218 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 176 - value: b'A715FXXSBDXB1\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 190 - value: b'2026:03:26 11:56:27\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe2\x00\x00\x00'
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d260610>
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Finstrument_cluster-1774702355675.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/instrument_cluster-1774702355675.jpg saved to cache
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 with identifier: 19443439
2026-03-29 20:22:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 with scrape type 1
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Fexterior_front_driver-1774693238750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_front_driver-1774693238750.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Fexterior_rear_driver-1774693343204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_driver-1774693343204.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3439%252F19443439%252Fexterior_front_passenger-1774695537591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3439/19443439/exterior_front_passenger-1774695537591.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Fexterior_rear_passenger-1774693392300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_passenger-1774693392300.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3439%252F19443439%252Finterior_front_seats-1774693649010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3439/19443439/interior_front_seats-1774693649010.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3439%252F19443439%252Finterior_rear_seats-1774693664393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3439/19443439/interior_rear_seats-1774693664393.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Finterior_dashboard-1774693702253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/interior_dashboard-1774693702253.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Finstrument_cluster-1774693763653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/instrument_cluster-1774693763653.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3439%252F19443439%252Finterior_boot-1774693736978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3439/19443439/interior_boot-1774693736978.jpg not downloaded yet
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3439%252F19443439%252Fdocs_service_history-1771872774698.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D876e3c0d49390f4b02335b7d853056b1%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3439/19443439/docs_service_history-1771872774698.jpg?ixlib=js-3.8.0&auto=format&s=876e3c0d49390f4b02335b7d853056b1 already downloaded
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8961/20408961/interior_rear_seats-1774704642860.jpg> (referer: None)
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c216250>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8961%252F20408961%252Finterior_rear_seats-1774704642860.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8961/20408961/interior_rear_seats-1774704642860.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_passenger-1774701613443.jpg> (referer: None)
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_passenger-1774701626187.jpg> (referer: None)
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3439/19443439/interior_boot-1774693736978.jpg> (referer: None)
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef65d0>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_rear_passenger-1774701613443.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_passenger-1774701613443.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba98d0>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_front_passenger-1774701626187.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_passenger-1774701626187.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d068ed0>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3439%252F19443439%252Finterior_boot-1774693736978.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3439/19443439/interior_boot-1774693736978.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8961/20408961/interior_front_seats-1774704068109.jpg> (referer: None)
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x12\x10'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\r\x8c'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A715F\x00'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 196 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'A715FXXSBDXB1\x00'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 218 - value: b'2026:03:28 13:09:23\x00'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xee'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x1e'
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca6f90>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8961%252F20408961%252Finterior_front_seats-1774704068109.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8961/20408961/interior_front_seats-1774704068109.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3439/19443439/interior_dashboard-1774693702253.jpg> (referer: None)
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf5650>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Finterior_dashboard-1774693702253.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/interior_dashboard-1774693702253.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3439/19443439/interior_front_seats-1774693649010.jpg> (referer: None)
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3439/19443439/instrument_cluster-1774693763653.jpg> (referer: None)
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3439/19443439/interior_rear_seats-1774693664393.jpg> (referer: None)
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce10910>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3439%252F19443439%252Finterior_front_seats-1774693649010.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3439/19443439/interior_front_seats-1774693649010.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3f9710>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Finstrument_cluster-1774693763653.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/instrument_cluster-1774693763653.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d784f90>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3439%252F19443439%252Finterior_rear_seats-1774693664393.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3439/19443439/interior_rear_seats-1774693664393.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_passenger-1774693392300.jpg> (referer: None)
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06a150>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Fexterior_rear_passenger-1774693392300.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_passenger-1774693392300.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3439/19443439/exterior_front_passenger-1774695537591.jpg> (referer: None)
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_driver-1774693343204.jpg> (referer: None)
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c230bd0>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3439%252F19443439%252Fexterior_front_passenger-1774695537591.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3439/19443439/exterior_front_passenger-1774695537591.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_front_driver-1774693238750.jpg> (referer: None)
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0b850>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Fexterior_rear_driver-1774693343204.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_driver-1774693343204.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d785cd0>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3439%252F19443439%252Fexterior_front_driver-1774693238750.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_front_driver-1774693238750.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19
2026-03-29 20:22:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 827c15d6-c295-543b-ad6f-7a5b8dbdeb19, skipping ID generation
2026-03-29 20:22:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 with scrape type 1
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 sending to next pipeline
2026-03-29 20:22:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 827c15d6-c295-543b-ad6f-7a5b8dbdeb19, identifier: 19443439
2026-03-29 20:22:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 with identifier: 19443439
2026-03-29 20:22:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 with identifier: 19443439
2026-03-29 20:22:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 827c15d6-c295-543b-ad6f-7a5b8dbdeb19 with identifier: 19443439 to the API
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_front_driver-1774693238750.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '827c15d6-c295-543b-ad6f-7a5b8dbdeb19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AK20 OSX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19443439',
'listing': 'auction',
'location': 'Greater London Bromley',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 19985,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1437927,
'Height': 2312,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_front_driver-1774693238750.jpg',
'Width': 3082},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2226461,
'Height': 2747,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_driver-1774693343204.jpg',
'Width': 3663},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3090320,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3439/19443439/exterior_front_passenger-1774695537591.jpg',
'Width': 3602},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944723,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3439/19443439/exterior_rear_passenger-1774693392300.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3625715,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3439/19443439/interior_front_seats-1774693649010.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3813055,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3439/19443439/interior_rear_seats-1774693664393.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3421092,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3439/19443439/interior_dashboard-1774693702253.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2446791,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3439/19443439/instrument_cluster-1774693763653.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_827c15d6-c295-543b-ad6f-7a5b8dbdeb19/827c15d6-c295-543b-ad6f-7a5b8dbdeb19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4130545,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3439/19443439/interior_boot-1774693736978.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_946142c2-7419-57dc-8fe8-a44d18c8dcef/946142c2-7419-57dc-8fe8-a44d18c8dcef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310681,
'Height': 2227,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3439/19443439/docs_service_history-1771872774698.jpg?ixlib=js-3.8.0&auto=format&s=876e3c0d49390f4b02335b7d853056b1',
'Width': 2969}],
'price': 35508,
'price_includes_vat': False,
'registration_date': '2020-07-07',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG E 53 4MATIC Auto',
'transmission': 'automatic',
'trim': 'E 53 4MATIC Auto',
'vin': 'WDD2384612F125726',
'year': 2020}
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719443439%27 HTTP/1.1" 200 None
2026-03-29 20:22:32 [motorway.uk] INFO: Saving data for 19443439: {'created_time': 1774815752.40413, 'last_price_update_time': 1774815752.40414, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19443439') HTTP/1.1" 204 0
2026-03-29 20:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_driver-1774701606837.jpg> (referer: None)
2026-03-29 20:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_driver-1774701636610.jpg> (referer: None)
2026-03-29 20:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_passenger-1774621840366.jpg> (referer: None)
2026-03-29 20:22:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1226/20171226/interior_rear_seats-1772990422123.jpg> (referer: None)
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce11290>
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_rear_driver-1774701606837.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_driver-1774701606837.jpg saved to cache
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cef4d10>
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8961%252F20408961%252Fexterior_front_driver-1774701636610.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_driver-1774701636610.jpg saved to cache
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f
2026-03-29 20:22:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fc6d10b-3d77-5de9-83de-a9e8a44db89f, skipping ID generation
2026-03-29 20:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f with scrape type 1
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fc6d10b-3d77-5de9-83de-a9e8a44db89f sending to next pipeline
2026-03-29 20:22:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9fc6d10b-3d77-5de9-83de-a9e8a44db89f, identifier: 20408961
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7a690>
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_rear_passenger-1774621840366.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_passenger-1774621840366.jpg saved to cache
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:22:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d570d10>
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1226%252F20171226%252Finterior_rear_seats-1772990422123.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1226/20171226/interior_rear_seats-1772990422123.jpg saved to cache
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:22:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9fc6d10b-3d77-5de9-83de-a9e8a44db89f with identifier: 20408961
2026-03-29 20:22:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9fc6d10b-3d77-5de9-83de-a9e8a44db89f with identifier: 20408961
2026-03-29 20:22:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9fc6d10b-3d77-5de9-83de-a9e8a44db89f with identifier: 20408961 to the API
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_driver-1774701636610.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9fc6d10b-3d77-5de9-83de-a9e8a44db89f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RA65 VWJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20408961',
'listing': 'auction',
'location': 'Buckinghamshire High Wycombe',
'make': 'Volkswagen',
'model': 'CC',
'odometer': 46960,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2058384,
'Height': 3447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_driver-1774701636610.jpg',
'Width': 4596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1380866,
'Height': 2940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_driver-1774701606837.jpg',
'Width': 3920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2013676,
'Height': 3333,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_front_passenger-1774701626187.jpg',
'Width': 4444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2042501,
'Height': 3094,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8961/20408961/exterior_rear_passenger-1774701613443.jpg',
'Width': 4125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3417735,
'Height': 3468,
'OriginUrl': 'https://motorway-photos.imgix.net/8961/20408961/interior_front_seats-1774704068109.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623542,
'Height': 3306,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8961/20408961/interior_rear_seats-1774704642860.jpg',
'Width': 4408},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1454676,
'Height': 2659,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8961/20408961/interior_dashboard-1774704651600.jpg',
'Width': 3545},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2961609,
'Height': 3468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8961/20408961/instrument_cluster-1774702355675.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4145531,
'Height': 3468,
'OriginUrl': 'https://motorway-photos.imgix.net/8961/20408961/interior_boot-1774704090928.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc6d10b-3d77-5de9-83de-a9e8a44db89f/9fc6d10b-3d77-5de9-83de-a9e8a44db89f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3335853,
'Height': 3468,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8961/20408961/docs_service_history-1774704131026.jpg?ixlib=js-3.8.0&auto=format&s=ddf47a1d8f8e59bbac2ab5787bb9bba3',
'Width': 4624}],
'price': 8413,
'price_includes_vat': False,
'registration_date': '2016-01-04',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen CC R Line TDI BMT S-A',
'transmission': 'automatic',
'trim': 'R Line TDI BMT S-A',
'vin': 'WVWZZZ3CZGE508041',
'year': 2016}
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720408961%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [motorway.uk] INFO: Saving data for 20408961: {'created_time': 1774815753.408916, 'last_price_update_time': 1774815753.408927, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20408961') HTTP/1.1" 204 0
2026-03-29 20:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18465053.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_passenger-1772990117193.jpg> (referer: None)
2026-03-29 20:22:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5a4d55-9429-5e9a-b1f9-3d699049c1fc with identifier: 18465053
2026-03-29 20:22:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc with scrape type 1
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_front_driver-1774699814216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_driver-1774699814216.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_rear_driver-1774699802375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_driver-1774699802375.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_front_passenger-1774699766991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_passenger-1774699766991.jpg not downloaded yet
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02d9d0>
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1226%252F20171226%252Fexterior_rear_passenger-1772990117193.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_passenger-1772990117193.jpg saved to cache
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_rear_passenger-1774699790994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_passenger-1774699790994.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5053%252F18465053%252Finterior_front_seats-1774700234718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5053/18465053/interior_front_seats-1774700234718.jpg not downloaded yet
2026-03-29 20:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_passenger-1774621852395.jpg> (referer: None)
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5053%252F18465053%252Finterior_rear_seats-1774700264422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5053/18465053/interior_rear_seats-1774700264422.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Finterior_dashboard-1774700314577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/interior_dashboard-1774700314577.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Finstrument_cluster-1774700333732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/instrument_cluster-1774700333732.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5053%252F18465053%252Finterior_boot-1774700314961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5053/18465053/interior_boot-1774700314961.jpg not downloaded yet
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5053%252F18465053%252Fdocs_service_history-1774700793346.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa0e911ac8c95378353ab22d61af8f32%27 HTTP/1.1" 200 None
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5053/18465053/docs_service_history-1774700793346.jpg?ixlib=js-3.8.0&auto=format&s=fa0e911ac8c95378353ab22d61af8f32 not downloaded yet
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b8d50>
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_front_passenger-1774621852395.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_passenger-1774621852395.jpg saved to cache
2026-03-29 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_driver-1774621810072.jpg> (referer: None)
2026-03-29 20:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_driver-1772990104153.jpg> (referer: None)
2026-03-29 20:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_driver-1774621832361.jpg> (referer: None)
2026-03-29 20:22:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_passenger-1773074792087.jpg> (referer: None)
2026-03-29 20:22:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5053/18465053/docs_service_history-1774700793346.jpg?ixlib=js-3.8.0&auto=format&s=fa0e911ac8c95378353ab22d61af8f32> (referer: None)
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d8750>
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_front_driver-1774621810072.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_driver-1774621810072.jpg saved to cache
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b2690>
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1226%252F20171226%252Fexterior_rear_driver-1772990104153.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_driver-1772990104153.jpg saved to cache
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9279d0>
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3563%252F18543563%252Fexterior_rear_driver-1774621832361.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_driver-1774621832361.jpg saved to cache
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cabe4627-1893-53dd-a5cb-f7480507fe66
2026-03-29 20:22:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cabe4627-1893-53dd-a5cb-f7480507fe66, skipping ID generation
2026-03-29 20:22:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cabe4627-1893-53dd-a5cb-f7480507fe66 with scrape type 1
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cabe4627-1893-53dd-a5cb-f7480507fe66 sending to next pipeline
2026-03-29 20:22:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cabe4627-1893-53dd-a5cb-f7480507fe66, identifier: 18543563
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d8ad0>
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Fexterior_front_passenger-1773074792087.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_passenger-1773074792087.jpg saved to cache
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca642d0>
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5053%252F18465053%252Fdocs_service_history-1774700793346.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa0e911ac8c95378353ab22d61af8f32') HTTP/1.1" 204 0
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5053/18465053/docs_service_history-1774700793346.jpg?ixlib=js-3.8.0&auto=format&s=fa0e911ac8c95378353ab22d61af8f32 saved to cache
2026-03-29 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cabe4627-1893-53dd-a5cb-f7480507fe66 with identifier: 18543563
2026-03-29 20:22:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cabe4627-1893-53dd-a5cb-f7480507fe66 with identifier: 18543563
2026-03-29 20:22:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cabe4627-1893-53dd-a5cb-f7480507fe66 with identifier: 18543563 to the API
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_driver-1774621832361.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cabe4627-1893-53dd-a5cb-f7480507fe66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VO23 TZP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18543563',
'listing': 'auction',
'location': 'Gloucestershire Gloucester',
'make': 'Audi',
'model': 'A1',
'odometer': 12300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1554057,
'Height': 2344,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_driver-1774621810072.jpg',
'Width': 3125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1750142,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_driver-1774621832361.jpg',
'Width': 3435},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1941647,
'Height': 2598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_front_passenger-1774621852395.jpg',
'Width': 3464},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1698046,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3563/18543563/exterior_rear_passenger-1774621840366.jpg',
'Width': 3267},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4239607,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3563/18543563/interior_front_seats-1774622224116.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4879507,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3563/18543563/interior_rear_seats-1774622239723.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2273128,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3563/18543563/instrument_cluster-1774622281855.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3422395,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3563/18543563/interior_boot-1774622350517.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabe4627-1893-53dd-a5cb-f7480507fe66/cabe4627-1893-53dd-a5cb-f7480507fe66_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301187,
'Height': 2778,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3563/18543563/docs_service_history-1774622728428.jpg?ixlib=js-3.8.0&auto=format&s=875c4883d710001e926406c3a119d923',
'Width': 1284}],
'price': 17825,
'price_includes_vat': False,
'registration_date': '2023-06-10',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line 30 TFSI',
'transmission': 'manual',
'trim': 'S Line 30 TFSI',
'vin': 'WAUZZZGB7PR057663',
'year': 2023}
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718543563%27 HTTP/1.1" 200 None
2026-03-29 20:22:35 [motorway.uk] INFO: Saving data for 18543563: {'created_time': 1774815755.073013, 'last_price_update_time': 1774815755.073023, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18543563') HTTP/1.1" 204 0
2026-03-29 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5053/18465053/interior_front_seats-1774700234718.jpg> (referer: None)
2026-03-29 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5053/18465053/instrument_cluster-1774700333732.jpg> (referer: None)
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d263990>
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5053%252F18465053%252Finterior_front_seats-1774700234718.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5053/18465053/interior_front_seats-1774700234718.jpg saved to cache
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c665450>
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Finstrument_cluster-1774700333732.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/instrument_cluster-1774700333732.jpg saved to cache
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_passenger-1774699790994.jpg> (referer: None)
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad6790>
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_rear_passenger-1774699790994.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_passenger-1774699790994.jpg saved to cache
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5053/18465053/interior_dashboard-1774700314577.jpg> (referer: None)
2026-03-29 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5053/18465053/interior_rear_seats-1774700264422.jpg> (referer: None)
2026-03-29 20:22:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_passenger-1774699766991.jpg> (referer: None)
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1b790>
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Finterior_dashboard-1774700314577.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/interior_dashboard-1774700314577.jpg saved to cache
2026-03-29 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad5ad0>
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5053%252F18465053%252Finterior_rear_seats-1774700264422.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5053/18465053/interior_rear_seats-1774700264422.jpg saved to cache
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20444774.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c665450>
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_front_passenger-1774699766991.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_passenger-1774699766991.jpg saved to cache
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 with identifier: 20444774
2026-03-29 20:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 with scrape type 1
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_front_driver-1774537263089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_driver-1774537263089.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_rear_driver-1774514467627.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_driver-1774514467627.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_front_passenger-1774514489302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_passenger-1774514489302.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_rear_passenger-1774514482770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_passenger-1774514482770.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4774%252F20444774%252Finterior_front_seats-1774514742330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4774/20444774/interior_front_seats-1774514742330.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4774%252F20444774%252Finterior_rear_seats-1774514750174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4774/20444774/interior_rear_seats-1774514750174.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Finterior_dashboard-1774514774032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/interior_dashboard-1774514774032.jpg not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4774%252F20444774%252Finterior_boot-1774514772164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4774/20444774/interior_boot-1774514772164.jpg not downloaded yet
2026-03-29 20:22:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_driver-1774699802375.jpg> (referer: None)
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4774%252F20444774%252Fdocs_service_history-1774537189421.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De04fa8517963808c7d6e6a41b7856533%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537189421.jpg?ixlib=js-3.8.0&auto=format&s=e04fa8517963808c7d6e6a41b7856533 not downloaded yet
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4774%252F20444774%252Fdocs_service_history-1774537194131.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7eae204a2338491224079b51f95019f6%27 HTTP/1.1" 200 None
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537194131.jpg?ixlib=js-3.8.0&auto=format&s=7eae204a2338491224079b51f95019f6 not downloaded yet
2026-03-29 20:22:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_driver-1774699814216.jpg> (referer: None)
2026-03-29 20:22:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5053/18465053/interior_boot-1774700314961.jpg> (referer: None)
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9d7590>
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_rear_driver-1774699802375.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_driver-1774699802375.jpg saved to cache
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eab14d0>
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5053%252F18465053%252Fexterior_front_driver-1774699814216.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_driver-1774699814216.jpg saved to cache
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3fa110>
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5053%252F18465053%252Finterior_boot-1774700314961.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5053/18465053/interior_boot-1774700314961.jpg saved to cache
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc
2026-03-29 20:22:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac5a4d55-9429-5e9a-b1f9-3d699049c1fc, skipping ID generation
2026-03-29 20:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc with scrape type 1
2026-03-29 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac5a4d55-9429-5e9a-b1f9-3d699049c1fc sending to next pipeline
2026-03-29 20:22:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ac5a4d55-9429-5e9a-b1f9-3d699049c1fc, identifier: 18465053
2026-03-29 20:22:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ac5a4d55-9429-5e9a-b1f9-3d699049c1fc with identifier: 18465053
2026-03-29 20:22:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ac5a4d55-9429-5e9a-b1f9-3d699049c1fc with identifier: 18465053
2026-03-29 20:22:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ac5a4d55-9429-5e9a-b1f9-3d699049c1fc with identifier: 18465053 to the API
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5053/18465053/interior_boot-1774700314961.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ac5a4d55-9429-5e9a-b1f9-3d699049c1fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS64 MHV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18465053',
'listing': 'auction',
'location': 'Hertfordshire Welwyn Garden City',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 93988,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2744340,
'Height': 2899,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_driver-1774699814216.jpg',
'Width': 3865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2138340,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_driver-1774699802375.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1473430,
'Height': 2232,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_front_passenger-1774699766991.jpg',
'Width': 2976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1372814,
'Height': 2115,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5053/18465053/exterior_rear_passenger-1774699790994.jpg',
'Width': 2820},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2944103,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5053/18465053/interior_front_seats-1774700234718.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4164346,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5053/18465053/interior_rear_seats-1774700264422.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2226382,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5053/18465053/interior_dashboard-1774700314577.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3079345,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5053/18465053/instrument_cluster-1774700333732.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3283893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5053/18465053/interior_boot-1774700314961.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5a4d55-9429-5e9a-b1f9-3d699049c1fc/ac5a4d55-9429-5e9a-b1f9-3d699049c1fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803465,
'Height': 2039,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5053/18465053/docs_service_history-1774700793346.jpg?ixlib=js-3.8.0&auto=format&s=fa0e911ac8c95378353ab22d61af8f32',
'Width': 2789}],
'price': 4475,
'price_includes_vat': False,
'registration_date': '2014-12-29',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Touran SE BlueMotion T TDI S-A',
'transmission': 'automatic',
'trim': 'SE BlueMotion T TDI S-A',
'vin': 'WVGZZZ1TZEW091390',
'year': 2014}
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718465053%27 HTTP/1.1" 200 None
2026-03-29 20:22:37 [motorway.uk] INFO: Saving data for 18465053: {'created_time': 1774815757.298394, 'last_price_update_time': 1774815757.298405, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18465053') HTTP/1.1" 204 0
2026-03-29 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537194131.jpg?ixlib=js-3.8.0&auto=format&s=7eae204a2338491224079b51f95019f6> (referer: None)
2026-03-29 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_driver-1773074743540.jpg> (referer: None)
2026-03-29 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_passenger-1774691880216.jpeg> (referer: None)
2026-03-29 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4774/20444774/interior_dashboard-1774514774032.jpg> (referer: None)
2026-03-29 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4459/18634459/interior_boot-1774631490350.jpg> (referer: None)
2026-03-29 20:22:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537189421.jpg?ixlib=js-3.8.0&auto=format&s=e04fa8517963808c7d6e6a41b7856533> (referer: None)
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07d590>
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4774%252F20444774%252Fdocs_service_history-1774537194131.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7eae204a2338491224079b51f95019f6') HTTP/1.1" 204 0
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537194131.jpg?ixlib=js-3.8.0&auto=format&s=7eae204a2338491224079b51f95019f6 saved to cache
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1391d0>
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1226%252F20171226%252Fexterior_front_driver-1773074743540.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_driver-1773074743540.jpg saved to cache
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d005c8fa-b876-5cf7-965e-ce6be132cfe8
2026-03-29 20:22:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d005c8fa-b876-5cf7-965e-ce6be132cfe8, skipping ID generation
2026-03-29 20:22:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d005c8fa-b876-5cf7-965e-ce6be132cfe8 with scrape type 1
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d005c8fa-b876-5cf7-965e-ce6be132cfe8 sending to next pipeline
2026-03-29 20:22:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d005c8fa-b876-5cf7-965e-ce6be132cfe8, identifier: 20171226
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d784710>
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9339%252F11969339%252Fexterior_front_passenger-1774691880216.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_passenger-1774691880216.jpeg saved to cache
2026-03-29 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40aad7e7-65e0-58a8-b442-438b46772d00
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafb850>
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Finterior_dashboard-1774514774032.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/interior_dashboard-1774514774032.jpg saved to cache
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c257310>
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4459%252F18634459%252Finterior_boot-1774631490350.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4459/18634459/interior_boot-1774631490350.jpg saved to cache
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:22:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d005c8fa-b876-5cf7-965e-ce6be132cfe8 with identifier: 20171226
2026-03-29 20:22:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d005c8fa-b876-5cf7-965e-ce6be132cfe8 with identifier: 20171226
2026-03-29 20:22:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d005c8fa-b876-5cf7-965e-ce6be132cfe8 with identifier: 20171226 to the API
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_driver-1773074743540.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'd005c8fa-b876-5cf7-965e-ce6be132cfe8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN24 WEC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20171226',
'listing': 'auction',
'location': 'Wrexham Principal Area Wrexham',
'make': 'Nissan',
'model': 'Leaf',
'odometer': 8350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2500586,
'Height': 2716,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_driver-1773074743540.jpg',
'Width': 3621},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1500548,
'Height': 2406,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_driver-1772990104153.jpg',
'Width': 3208},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597031,
'Height': 2746,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1226/20171226/exterior_front_passenger-1773074792087.jpg',
'Width': 3661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1821540,
'Height': 2578,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1226/20171226/exterior_rear_passenger-1772990117193.jpg',
'Width': 3437},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2703146,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1226/20171226/interior_rear_seats-1772990422123.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685036,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1226/20171226/interior_boot-1772990462307.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378447,
'Height': 1220,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1226/20171226/docs_service_history-1772990591126.jpg?ixlib=js-3.8.0&auto=format&s=13a2c85674d1819d2583ca5d5490ef4e',
'Width': 3625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d005c8fa-b876-5cf7-965e-ce6be132cfe8/d005c8fa-b876-5cf7-965e-ce6be132cfe8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208392,
'Height': 870,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1226/20171226/damage_scratches-1773074100501.jpg',
'Width': 1161}],
'price': 10319,
'price_includes_vat': False,
'registration_date': '2024-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Leaf Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'vin': 'SJNFAAZE1U0199074',
'year': 2024}
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720171226%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [motorway.uk] INFO: Saving data for 20171226: {'created_time': 1774815758.691613, 'last_price_update_time': 1774815758.691624, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20171226') HTTP/1.1" 204 0
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafa890>
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4774%252F20444774%252Fdocs_service_history-1774537189421.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De04fa8517963808c7d6e6a41b7856533') HTTP/1.1" 204 0
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537189421.jpg?ixlib=js-3.8.0&auto=format&s=e04fa8517963808c7d6e6a41b7856533 saved to cache
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4774/20444774/interior_boot-1774514772164.jpg> (referer: None)
2026-03-29 20:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4774/20444774/interior_rear_seats-1774514750174.jpg> (referer: None)
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce11c90>
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4774%252F20444774%252Finterior_boot-1774514772164.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4774/20444774/interior_boot-1774514772164.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2155d0>
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4774%252F20444774%252Finterior_rear_seats-1774514750174.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4774/20444774/interior_rear_seats-1774514750174.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20338223.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_passenger-1774514489302.jpg> (referer: None)
2026-03-29 20:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4774/20444774/interior_front_seats-1774514742330.jpg> (referer: None)
2026-03-29 20:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_driver-1774537263089.jpg> (referer: None)
2026-03-29 20:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_driver-1774514467627.jpg> (referer: None)
2026-03-29 20:22:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b3ca00f-abc2-5cba-9f24-25f9aade82da with identifier: 20338223
2026-03-29 20:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da with scrape type 1
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_front_driver-1774706705179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_front_driver-1774706705179.jpg not downloaded yet
2026-03-29 20:22:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_passenger-1774514482770.jpg> (referer: None)
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_rear_driver-1774706722199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_driver-1774706722199.jpg not downloaded yet
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_front_passenger-1774706759180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_front_passenger-1774706759180.jpg not downloaded yet
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca880d0>
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_front_passenger-1774514489302.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_passenger-1774514489302.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d2bd0>
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4774%252F20444774%252Finterior_front_seats-1774514742330.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4774/20444774/interior_front_seats-1774514742330.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_rear_passenger-1774706739462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_passenger-1774706739462.jpg not downloaded yet
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c241610>
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_front_driver-1774537263089.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_driver-1774537263089.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d242c90>
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_rear_driver-1774514467627.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_driver-1774514467627.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20338223%252Finterior_front_seats-1774707621092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20338223/interior_front_seats-1774707621092.jpg not downloaded yet
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c654e50>
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4774%252F20444774%252Fexterior_rear_passenger-1774514482770.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_passenger-1774514482770.jpg saved to cache
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4
2026-03-29 20:22:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4, skipping ID generation
2026-03-29 20:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 with scrape type 1
2026-03-29 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 sending to next pipeline
2026-03-29 20:22:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4, identifier: 20444774
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20338223%252Finterior_rear_seats-1774707649190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20338223/interior_rear_seats-1774707649190.jpg not downloaded yet
2026-03-29 20:22:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 with identifier: 20444774
2026-03-29 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 with identifier: 20444774
2026-03-29 20:22:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4 with identifier: 20444774 to the API
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_passenger-1774514482770.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ET72 PSU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20444774',
'listing': 'auction',
'location': 'Essex Grays',
'make': 'Ford',
'model': 'Puma',
'odometer': 38110,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1325026,
'Height': 2122,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_driver-1774537263089.jpg',
'Width': 2829},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1138887,
'Height': 2498,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_driver-1774514467627.jpg',
'Width': 3330},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1328016,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_front_passenger-1774514489302.jpg',
'Width': 3159},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2145287,
'Height': 2945,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4774/20444774/exterior_rear_passenger-1774514482770.jpg',
'Width': 3927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3123314,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4774/20444774/interior_front_seats-1774514742330.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3283629,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4774/20444774/interior_rear_seats-1774514750174.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3046679,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4774/20444774/interior_dashboard-1774514774032.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3326013,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4774/20444774/interior_boot-1774514772164.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520084,
'Height': 2796,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537189421.jpg?ixlib=js-3.8.0&auto=format&s=e04fa8517963808c7d6e6a41b7856533',
'Width': 1290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4/71bd0a52-4f1f-51f2-b4ff-eb61757ffdc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533961,
'Height': 2796,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4774/20444774/docs_service_history-1774537194131.jpg?ixlib=js-3.8.0&auto=format&s=7eae204a2338491224079b51f95019f6',
'Width': 1290}],
'price': 13121,
'price_includes_vat': False,
'registration_date': '2022-09-16',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma ST-LINE X MHEV Auto',
'transmission': 'automatic',
'trim': 'ST-LINE X MHEV Auto',
'vin': 'WF02XXERK2NM72811',
'year': 2022}
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720444774%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [motorway.uk] INFO: Saving data for 20444774: {'created_time': 1774815760.438434, 'last_price_update_time': 1774815760.438445, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20444774') HTTP/1.1" 204 0
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Finterior_dashboard-1774707666896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/interior_dashboard-1774707666896.jpg not downloaded yet
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Finstrument_cluster-1774707717372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/instrument_cluster-1774707717372.jpg not downloaded yet
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20338223%252Finterior_boot-1774707678211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20338223/interior_boot-1774707678211.jpg not downloaded yet
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8223%252F20338223%252Fdocs_service_history-1774708423879-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D468a6a0a1770e1e00a4919e020640bfc%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20338223/docs_service_history-1774708423879-1.jpeg?ixlib=js-3.8.0&auto=format&s=468a6a0a1770e1e00a4919e020640bfc not downloaded yet
2026-03-29 20:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4459/18634459/interior_dashboard-1774631447491.jpg> (referer: None)
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 65881d93-46cb-5528-a8d1-f46d766c9a89 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 40aad7e7-65e0-58a8-b442-438b46772d00 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 40aad7e7-65e0-58a8-b442-438b46772d00 with identifier: 11969339
2026-03-29 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 40aad7e7-65e0-58a8-b442-438b46772d00 with identifier: 11969339
2026-03-29 20:22:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 40aad7e7-65e0-58a8-b442-438b46772d00 with identifier: 11969339 to the API
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:40 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '40aad7e7-65e0-58a8-b442-438b46772d00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LD70 TXU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11969339',
'listing': 'auction',
'location': 'Cheshire East Alderley Edge',
'make': 'MG',
'model': 'ZS',
'odometer': 44469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 67,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_driver-1774691306306.jpeg',
'https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_driver-1774691371462.jpeg',
'https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_passenger-1774691880216.jpeg',
'https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_passenger-1774691388410.jpeg',
'https://motorway-photos.imgix.net/9339/11969339/interior_front_seats-1774691563752.jpeg',
'https://motorway-photos.imgix.net/9339/11969339/interior_rear_seats-1774692281029.jpeg',
'https://motorway-photos-redacted.imgix.net/9339/11969339/interior_dashboard-1774691696796.jpeg',
'https://motorway-photos-redacted.imgix.net/9339/11969339/instrument_cluster-1774691722448.jpeg',
'https://motorway-photos.imgix.net/9339/11969339/interior_boot-1774691708249.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/9339/11969339/docs_service_history-1774709578153.jpeg?ixlib=js-3.8.0&auto=format&s=59f792a28c83a860059a59c626b2e92e'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1410076,
'Height': 2590,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_front_passenger-1774691880216.jpeg',
'Width': 3453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267139,
'Height': 2915,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9339/11969339/exterior_rear_passenger-1774691388410.jpeg',
'Width': 3887},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3317066,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9339/11969339/interior_front_seats-1774691563752.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3110535,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9339/11969339/interior_rear_seats-1774692281029.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1788976,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9339/11969339/interior_dashboard-1774691696796.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2504799,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9339/11969339/instrument_cluster-1774691722448.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3748496,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9339/11969339/interior_boot-1774691708249.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40aad7e7-65e0-58a8-b442-438b46772d00/40aad7e7-65e0-58a8-b442-438b46772d00_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1131931,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9339/11969339/docs_service_history-1774709578153.jpeg?ixlib=js-3.8.0&auto=format&s=59f792a28c83a860059a59c626b2e92e',
'Width': 3024}],
'price': 9659,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seats_number': None,
'seller_name': None,
'title': 'MG ZS Exclusive T-GDi Auto',
'transmission': 'automatic',
'trim': 'Exclusive T-GDi Auto',
'vin': 'SDPW7CBECLZ101498',
'year': 2020}
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711969339%27 HTTP/1.1" 200 None
2026-03-29 20:22:40 [motorway.uk] INFO: Saving data for 11969339: {'created_time': 1774815760.898295, 'last_price_update_time': 1774815760.898305, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11969339') HTTP/1.1" 204 0
2026-03-29 20:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20338223/docs_service_history-1774708423879-1.jpeg?ixlib=js-3.8.0&auto=format&s=468a6a0a1770e1e00a4919e020640bfc> (referer: None)
2026-03-29 20:22:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 40aad7e7-65e0-58a8-b442-438b46772d00 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf02890>
2026-03-29 20:22:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Finterior_dashboard-1774631447491.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/interior_dashboard-1774631447491.jpg saved to cache
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02c5d0>
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8223%252F20338223%252Fdocs_service_history-1774708423879-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D468a6a0a1770e1e00a4919e020640bfc') HTTP/1.1" 204 0
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20338223/docs_service_history-1774708423879-1.jpeg?ixlib=js-3.8.0&auto=format&s=468a6a0a1770e1e00a4919e020640bfc saved to cache
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19346587.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_passenger-1774706739462.jpg> (referer: None)
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8223/20338223/interior_front_seats-1774707621092.jpg> (referer: None)
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_driver-1774706722199.jpg> (referer: None)
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_front_passenger-1774706759180.jpg> (referer: None)
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20249715.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898077d8-d6cc-5928-9731-5e6d98b87b8a with identifier: 19346587
2026-03-29 20:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898077d8-d6cc-5928-9731-5e6d98b87b8a with scrape type 1
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_front_driver-1774772135358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_front_driver-1774772135358.jpg not downloaded yet
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_rear_driver-1774772212602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_driver-1774772212602.jpg not downloaded yet
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_front_passenger-1774772258911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_front_passenger-1774772258911.jpg not downloaded yet
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbab910>
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_rear_passenger-1774706739462.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_passenger-1774706739462.jpg saved to cache
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3fbc90>
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20338223%252Finterior_front_seats-1774707621092.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20338223/interior_front_seats-1774707621092.jpg saved to cache
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_rear_passenger-1774772218980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_passenger-1774772218980.jpg not downloaded yet
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e3210>
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_rear_driver-1774706722199.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_driver-1774706722199.jpg saved to cache
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1a310>
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Fexterior_front_passenger-1774706759180.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_front_passenger-1774706759180.jpg saved to cache
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6587%252F19346587%252Finterior_front_seats-1774772726622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6587/19346587/interior_front_seats-1774772726622.jpg not downloaded yet
2026-03-29 20:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3151c5cb-f06b-5a28-be0e-eb30d291749f with identifier: 20249715
2026-03-29 20:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3151c5cb-f06b-5a28-be0e-eb30d291749f with scrape type 1
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_front_driver-1774434602208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_front_driver-1774434602208.jpg not downloaded yet
2026-03-29 20:22:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=648&page=18&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6587%252F19346587%252Finterior_rear_seats-1774772749766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6587/19346587/interior_rear_seats-1774772749766.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_rear_driver-1774434616224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_driver-1774434616224.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6587%252F19346587%252Finterior_dashboard-1774787793330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6587/19346587/interior_dashboard-1774787793330.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_front_passenger-1774434614285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_front_passenger-1774434614285.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Finstrument_cluster-1774772844035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/instrument_cluster-1774772844035.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_rear_passenger-1774434606003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_passenger-1774434606003.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6587%252F19346587%252Finterior_boot-1774772804393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6587/19346587/interior_boot-1774772804393.jpg not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9715%252F20249715%252Finterior_front_seats-1774435006837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9715/20249715/interior_front_seats-1774435006837.jpg not downloaded yet
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 18832294
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20381843
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20258462
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 18895198
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20482892
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482892%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 20482892: 1
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6587%252F19346587%252Fdocs_service_history-1774787752464.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41e3bd8d180e80333f77291ddeff75af%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6587/19346587/docs_service_history-1774787752464.jpg?ixlib=js-3.8.0&auto=format&s=41e3bd8d180e80333f77291ddeff75af not downloaded yet
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9715%252F20249715%252Finterior_rear_seats-1774435069977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9715/20249715/interior_rear_seats-1774435069977.jpg not downloaded yet
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20403490
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 16057618
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 17828032
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 19514884
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719514884%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 19514884: 1
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Finterior_dashboard-1774435010537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/interior_dashboard-1774435010537.jpg not downloaded yet
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20140691
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20484845
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20376881
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20297983
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720297983%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 20297983: 1
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Finstrument_cluster-1774435051668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/instrument_cluster-1774435051668.jpg not downloaded yet
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20488223
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488223%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 20488223: 1
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9715%252F20249715%252Finterior_boot-1774435008544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9715/20249715/interior_boot-1774435008544.jpg not downloaded yet
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20471931
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20493721
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20422784
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 3287660
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 16290111
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 14508639
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 18349158
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718349158%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 18349158: 1
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fwheels_front_driver-1774434746647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/wheels_front_driver-1774434746647.jpg not downloaded yet
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 5286387
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 17747789
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717747789%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 17747789: 1
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20215364
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20407647
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20115042
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720115042%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 20115042: 2
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 11558331
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711558331%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 11558331: 1
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 18342530
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 12851017
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20248084
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 15064019
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 16160235
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 3081875
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20429308
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 20485771
2026-03-29 20:22:42 [motorway.uk] INFO: Found listing with ID: 18505969
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718505969%27 HTTP/1.1" 200 None
2026-03-29 20:22:42 [motorway.uk] INFO: Scrape type for 18505969: 1
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_driver-1774772212602.jpg> (referer: None)
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8223/20338223/interior_rear_seats-1774707649190.jpg> (referer: None)
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20338223/instrument_cluster-1774707717372.jpg> (referer: None)
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20338223/interior_dashboard-1774707666896.jpg> (referer: None)
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8223/20338223/interior_boot-1774707678211.jpg> (referer: None)
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20481960.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_front_passenger-1774772258911.jpg> (referer: None)
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c404290>
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_rear_driver-1774772212602.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_driver-1774772212602.jpg saved to cache
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d041250>
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20338223%252Finterior_rear_seats-1774707649190.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20338223/interior_rear_seats-1774707649190.jpg saved to cache
2026-03-29 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c407850>
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Finstrument_cluster-1774707717372.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/instrument_cluster-1774707717372.jpg saved to cache
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1a5290>
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20338223%252Finterior_dashboard-1774707666896.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20338223/interior_dashboard-1774707666896.jpg saved to cache
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb96f10>
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20338223%252Finterior_boot-1774707678211.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20338223/interior_boot-1774707678211.jpg saved to cache
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da
2026-03-29 20:22:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b3ca00f-abc2-5cba-9f24-25f9aade82da, skipping ID generation
2026-03-29 20:22:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da with scrape type 1
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b3ca00f-abc2-5cba-9f24-25f9aade82da sending to next pipeline
2026-03-29 20:22:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4b3ca00f-abc2-5cba-9f24-25f9aade82da, identifier: 20338223
2026-03-29 20:22:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 with identifier: 20481960
2026-03-29 20:22:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 with scrape type 1
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_front_driver-1774691439395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_driver-1774691439395.jpg not downloaded yet
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7994d0>
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_front_passenger-1774772258911.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_front_passenger-1774772258911.jpg saved to cache
2026-03-29 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:22:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4b3ca00f-abc2-5cba-9f24-25f9aade82da with identifier: 20338223
2026-03-29 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4b3ca00f-abc2-5cba-9f24-25f9aade82da with identifier: 20338223
2026-03-29 20:22:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4b3ca00f-abc2-5cba-9f24-25f9aade82da with identifier: 20338223 to the API
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8223/20338223/interior_boot-1774707678211.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4b3ca00f-abc2-5cba-9f24-25f9aade82da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RE18 DZP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20338223',
'listing': 'auction',
'location': 'Staffordshire Rugeley',
'make': 'Jaguar',
'model': 'E-PACE',
'odometer': 64395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1710112,
'Height': 2453,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_driver-1774706722199.jpg',
'Width': 3270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2184593,
'Height': 2812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_front_passenger-1774706759180.jpg',
'Width': 3749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2668187,
'Height': 2820,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20338223/exterior_rear_passenger-1774706739462.jpg',
'Width': 3760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4480507,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8223/20338223/interior_front_seats-1774707621092.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5171123,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8223/20338223/interior_rear_seats-1774707649190.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3787127,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20338223/interior_dashboard-1774707666896.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2833263,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20338223/instrument_cluster-1774707717372.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4505826,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8223/20338223/interior_boot-1774707678211.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b3ca00f-abc2-5cba-9f24-25f9aade82da/4b3ca00f-abc2-5cba-9f24-25f9aade82da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57488,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20338223/docs_service_history-1774708423879-1.jpeg?ixlib=js-3.8.0&auto=format&s=468a6a0a1770e1e00a4919e020640bfc',
'Width': 892}],
'price': 8926,
'price_includes_vat': False,
'registration_date': '2018-06-03',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar E-PACE S D AWD Auto',
'transmission': 'automatic',
'trim': 'S D AWD Auto',
'vin': 'SADFA2AN7J1Z19104',
'year': 2018}
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720338223%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [motorway.uk] INFO: Saving data for 20338223: {'created_time': 1774815764.053428, 'last_price_update_time': 1774815764.053439, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20338223') HTTP/1.1" 204 0
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_rear_driver-1774691461363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_driver-1774691461363.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_front_passenger-1774691502427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_passenger-1774691502427.jpg not downloaded yet
2026-03-29 20:22:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_rear_passenger-1774691484577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_passenger-1774691484577.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1960%252F20481960%252Finterior_front_seats-1774691884732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1960/20481960/interior_front_seats-1774691884732.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1960%252F20481960%252Finterior_rear_seats-1774691911208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1960/20481960/interior_rear_seats-1774691911208.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Finterior_dashboard-1774691947110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/interior_dashboard-1774691947110.jpg not downloaded yet
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 65881d93-46cb-5528-a8d1-f46d766c9a89 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1960%252F20481960%252Finterior_boot-1774691948621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1960/20481960/interior_boot-1774691948621.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1960%252F20481960%252Fdamage_scratches-1774693261852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1960/20481960/damage_scratches-1774693261852.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1960%252F20481960%252Fdamage_dents-1774693163280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1960/20481960/damage_dents-1774693163280.jpg not downloaded yet
2026-03-29 20:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4459/18634459/interior_front_seats-1774631434363.jpg> (referer: None)
2026-03-29 20:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9715/20249715/interior_boot-1774435008544.jpg> (referer: None)
2026-03-29 20:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1960/20481960/damage_dents-1774693163280.jpg> (referer: None)
2026-03-29 20:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20307515.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14fb9d10>
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4459%252F18634459%252Finterior_front_seats-1774631434363.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4459/18634459/interior_front_seats-1774631434363.jpg saved to cache
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d786950>
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9715%252F20249715%252Finterior_boot-1774435008544.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9715/20249715/interior_boot-1774435008544.jpg saved to cache
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed99490>
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1960%252F20481960%252Fdamage_dents-1774693163280.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1960/20481960/damage_dents-1774693163280.jpg saved to cache
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c646be4a-0c13-5855-8f44-ec0f6774942e with identifier: 20307515
2026-03-29 20:22:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c646be4a-0c13-5855-8f44-ec0f6774942e with scrape type 1
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_front_driver-1774712952336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_driver-1774712952336.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_rear_driver-1774712951918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_rear_driver-1774712951918.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_front_passenger-1774712951986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_passenger-1774712951986.jpg not downloaded yet
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_rear_passenger-1774712953481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_rear_passenger-1774712953481.jpg not downloaded yet
2026-03-29 20:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1960/20481960/damage_scratches-1774693261852.jpg> (referer: None)
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Finterior_front_seats-1774713527032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/interior_front_seats-1774713527032.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Finterior_rear_seats-1774713526363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/interior_rear_seats-1774713526363.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7515%252F20307515%252Finterior_dashboard-1774714991505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7515/20307515/interior_dashboard-1774714991505.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Finterior_boot-1774713525248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/interior_boot-1774713525248.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Fdamage_scratches-1774713027843.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/damage_scratches-1774713027843.jpg not downloaded yet
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9715/20249715/wheels_front_driver-1774434746647.jpg> (referer: None)
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Fdamage_warning_lights-1774714382660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/damage_warning_lights-1774714382660.jpg not downloaded yet
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1510>
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1960%252F20481960%252Fdamage_scratches-1774693261852.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1960/20481960/damage_scratches-1774693261852.jpg saved to cache
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_driver-1774691439395.jpg> (referer: None)
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_driver-1774691461363.jpg> (referer: None)
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31e8d0>
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fwheels_front_driver-1774434746647.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/wheels_front_driver-1774434746647.jpg saved to cache
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c631790>
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_front_driver-1774691439395.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_driver-1774691439395.jpg saved to cache
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caf9c10>
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_rear_driver-1774691461363.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_driver-1774691461363.jpg saved to cache
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=684&page=19&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7515/20307515/interior_boot-1774713525248.jpg> (referer: None)
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1960/20481960/interior_boot-1774691948621.jpg> (referer: None)
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7515/20307515/damage_scratches-1774713027843.jpg> (referer: None)
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1960/20481960/interior_dashboard-1774691947110.jpg> (referer: None)
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7515/20307515/damage_warning_lights-1774714382660.jpg> (referer: None)
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 19564729
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719564729%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [motorway.uk] INFO: Scrape type for 19564729: 1
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 6226570
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276226570%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [motorway.uk] INFO: Scrape type for 6226570: 1
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 16486995
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 20460973
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460973%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [motorway.uk] INFO: Scrape type for 20460973: 1
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d281cd0>
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Finterior_boot-1774713525248.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/interior_boot-1774713525248.jpg saved to cache
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 20487463
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 20111851
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720111851%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [motorway.uk] INFO: Scrape type for 20111851: 0
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 20098217
2026-03-29 20:22:45 [motorway.uk] INFO: Found listing with ID: 19569480
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719569480%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [motorway.uk] INFO: Scrape type for 19569480: 1
2026-03-29 20:22:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e986450>
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1960%252F20481960%252Finterior_boot-1774691948621.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1960/20481960/interior_boot-1774691948621.jpg saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20468681
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468681%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 20468681: 1
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ab890>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Fdamage_scratches-1774713027843.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/damage_scratches-1774713027843.jpg saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca89b90>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Finterior_dashboard-1774691947110.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/interior_dashboard-1774691947110.jpg saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca8b950>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Fdamage_warning_lights-1774714382660.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/damage_warning_lights-1774714382660.jpg saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c646be4a-0c13-5855-8f44-ec0f6774942e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 14866645
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 13203122
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713203122%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 13203122: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 15371876
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 17858829
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 8664899
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 14729168
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714729168%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 14729168: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 13365584
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 19518797
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 19781742
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 18114762
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718114762%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 18114762: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20484591
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484591%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 20484591: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 4393703
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274393703%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 4393703: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 19625865
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20021655
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720021655%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 20021655: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 4895685
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20426345
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 15364589
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715364589%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 15364589: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20450018
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 17809359
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20487947
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20346112
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 15189137
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20366507
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 13105341
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713105341%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [motorway.uk] INFO: Scrape type for 13105341: 1
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 19925177
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 19729177
2026-03-29 20:22:46 [motorway.uk] INFO: Found listing with ID: 20387159
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7515/20307515/interior_dashboard-1774714991505.jpg> (referer: None)
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7515/20307515/interior_front_seats-1774713527032.jpg> (referer: None)
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7515/20307515/interior_rear_seats-1774713526363.jpg> (referer: None)
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e9510>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7515%252F20307515%252Finterior_dashboard-1774714991505.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7515/20307515/interior_dashboard-1774714991505.jpg saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d26b390>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Finterior_front_seats-1774713527032.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/interior_front_seats-1774713527032.jpg saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce42fd0>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7515%252F20307515%252Finterior_rear_seats-1774713526363.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7515/20307515/interior_rear_seats-1774713526363.jpg saved to cache
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:22:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11558331.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18505969.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 with identifier: 11558331
2026-03-29 20:22:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 with scrape type 1
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_front_driver-1774457779902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_driver-1774457779902.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_rear_driver-1774457787825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_driver-1774457787825.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_front_passenger-1774457811007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_passenger-1774457811007.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_rear_passenger-1774457797433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_passenger-1774457797433.jpg not downloaded yet
2026-03-29 20:22:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69505459-81a0-5431-aa1e-5c0ed65da658 with identifier: 18505969
2026-03-29 20:22:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69505459-81a0-5431-aa1e-5c0ed65da658 with scrape type 1
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_front_driver-1774703650804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_driver-1774703650804.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F11558331%252Finterior_front_seats-1774628372471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/11558331/interior_front_seats-1774628372471.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_rear_driver-1774703678803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_driver-1774703678803.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F11558331%252Finterior_rear_seats-1774628410802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/11558331/interior_rear_seats-1774628410802.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_front_passenger-1774703727125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_passenger-1774703727125.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Finterior_dashboard-1774628450003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/interior_dashboard-1774628450003.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_rear_passenger-1774703755927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_passenger-1774703755927.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Finstrument_cluster-1774628460425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/instrument_cluster-1774628460425.jpg not downloaded yet
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5969%252F18505969%252Finterior_front_seats-1774704230878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5969/18505969/interior_front_seats-1774704230878.jpg not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F11558331%252Finterior_boot-1774628476447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/11558331/interior_boot-1774628476447.jpg not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5969%252F18505969%252Finterior_rear_seats-1774704276035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5969/18505969/interior_rear_seats-1774704276035.jpg not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8331%252F11558331%252Fdocs_service_history-1774628720503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5947f55b1cc02794888c6067f4a9d5fb%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8331/11558331/docs_service_history-1774628720503.jpg?ixlib=js-3.8.0&auto=format&s=5947f55b1cc02794888c6067f4a9d5fb not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5969%252F18505969%252Finterior_dashboard-1774708920339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5969/18505969/interior_dashboard-1774708920339.jpg not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Finstrument_cluster-1774704268447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/instrument_cluster-1774704268447.jpg not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5969%252F18505969%252Finterior_boot-1774704358754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5969/18505969/interior_boot-1774704358754.jpg not downloaded yet
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5969%252F18505969%252Fdocs_service_history-1774706027906.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9ffb3beb464383595568b3eefe1bb86%27 HTTP/1.1" 200 None
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5969/18505969/docs_service_history-1774706027906.jpg?ixlib=js-3.8.0&auto=format&s=d9ffb3beb464383595568b3eefe1bb86 not downloaded yet
2026-03-29 20:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20115042.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a28b93-a08d-514e-85b0-0fb06ad6aab9 with identifier: 20115042
2026-03-29 20:22:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a28b93-a08d-514e-85b0-0fb06ad6aab9 with scrape type 2
2026-03-29 20:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a28b93-a08d-514e-85b0-0fb06ad6aab9 with scrape type 2
2026-03-29 20:22:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 89a28b93-a08d-514e-85b0-0fb06ad6aab9, identifier: 20115042
2026-03-29 20:22:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 89a28b93-a08d-514e-85b0-0fb06ad6aab9 with identifier: 20115042
2026-03-29 20:22:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 89a28b93-a08d-514e-85b0-0fb06ad6aab9 with identifier: 20115042
2026-03-29 20:22:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 89a28b93-a08d-514e-85b0-0fb06ad6aab9 with identifier: 20115042 to the API
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20115042.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '89a28b93-a08d-514e-85b0-0fb06ad6aab9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AF21 SPV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20115042',
'listing': 'auction',
'location': 'Hartlepool Hartlepool',
'make': 'BMW',
'model': '8 Series',
'odometer': 64083,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 26367,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW 840I M Sport Auto',
'transmission': 'automatic',
'trim': '840I M Sport Auto',
'vin': 'WBAGV22090CG68709',
'year': 2021}
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720115042%27 HTTP/1.1" 200 None
2026-03-29 20:22:55 [motorway.uk] INFO: Saving data for 20115042: {'auction_closing_time': 1774884600.0, 'created_time': 1774470646.616614, 'last_price_update_time': 1774815775.428533}
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20115042') HTTP/1.1" 204 0
2026-03-29 20:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5969/18505969/docs_service_history-1774706027906.jpg?ixlib=js-3.8.0&auto=format&s=d9ffb3beb464383595568b3eefe1bb86> (referer: None)
2026-03-29 20:22:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d160110>
2026-03-29 20:22:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5969%252F18505969%252Fdocs_service_history-1774706027906.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9ffb3beb464383595568b3eefe1bb86') HTTP/1.1" 204 0
2026-03-29 20:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5969/18505969/docs_service_history-1774706027906.jpg?ixlib=js-3.8.0&auto=format&s=d9ffb3beb464383595568b3eefe1bb86 saved to cache
2026-03-29 20:22:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:22:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5969/18505969/interior_boot-1774704358754.jpg> (referer: None)
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d163b90>
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5969%252F18505969%252Finterior_boot-1774704358754.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5969/18505969/interior_boot-1774704358754.jpg saved to cache
2026-03-29 20:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5969/18505969/instrument_cluster-1774704268447.jpg> (referer: None)
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12e450>
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Finstrument_cluster-1774704268447.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/instrument_cluster-1774704268447.jpg saved to cache
2026-03-29 20:22:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5969/18505969/interior_dashboard-1774708920339.jpg> (referer: None)
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d162f50>
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5969%252F18505969%252Finterior_dashboard-1774708920339.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5969/18505969/interior_dashboard-1774708920339.jpg saved to cache
2026-03-29 20:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:22:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8331/11558331/docs_service_history-1774628720503.jpg?ixlib=js-3.8.0&auto=format&s=5947f55b1cc02794888c6067f4a9d5fb> (referer: None)
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12ec50>
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8331%252F11558331%252Fdocs_service_history-1774628720503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5947f55b1cc02794888c6067f4a9d5fb') HTTP/1.1" 204 0
2026-03-29 20:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8331/11558331/docs_service_history-1774628720503.jpg?ixlib=js-3.8.0&auto=format&s=5947f55b1cc02794888c6067f4a9d5fb saved to cache
2026-03-29 20:22:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:22:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460973.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18716bff-94a4-5f11-b5b0-984e642a8257 with identifier: 20460973
2026-03-29 20:22:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18716bff-94a4-5f11-b5b0-984e642a8257 with scrape type 1
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_front_driver-1774715378999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_driver-1774715378999.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_rear_driver-1774715402093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_driver-1774715402093.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_front_passenger-1774715452429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_passenger-1774715452429.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_rear_passenger-1774715428175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_passenger-1774715428175.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F20460973%252Finterior_front_seats-1774717506538.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/20460973/interior_front_seats-1774717506538.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F20460973%252Finterior_rear_seats-1774716243455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/20460973/interior_rear_seats-1774716243455.jpg not downloaded yet
2026-03-29 20:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5969/18505969/interior_rear_seats-1774704276035.jpg> (referer: None)
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F20460973%252Finterior_dashboard-1774717521203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/20460973/interior_dashboard-1774717521203.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F20460973%252Finterior_boot-1774716315169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/20460973/interior_boot-1774716315169.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0973%252F20460973%252Fdocs_service_history-1774716904447.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dea4cddab67391e236c76fd8dfd2f4551%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0973/20460973/docs_service_history-1774716904447.jpg?ixlib=js-3.8.0&auto=format&s=ea4cddab67391e236c76fd8dfd2f4551 not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F20460973%252Fdamage_scratches-1774715523618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/20460973/damage_scratches-1774715523618.jpg not downloaded yet
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e0c50>
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5969%252F18505969%252Finterior_rear_seats-1774704276035.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5969/18505969/interior_rear_seats-1774704276035.jpg saved to cache
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/11558331/interior_boot-1774628476447.jpg> (referer: None)
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c655e90>
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F11558331%252Finterior_boot-1774628476447.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/11558331/interior_boot-1774628476447.jpg saved to cache
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0973/20460973/interior_rear_seats-1774716243455.jpg> (referer: None)
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15afd0>
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F20460973%252Finterior_rear_seats-1774716243455.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/20460973/interior_rear_seats-1774716243455.jpg saved to cache
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0973/20460973/docs_service_history-1774716904447.jpg?ixlib=js-3.8.0&auto=format&s=ea4cddab67391e236c76fd8dfd2f4551> (referer: None)
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0973/20460973/damage_scratches-1774715523618.jpg> (referer: None)
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2292d0>
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0973%252F20460973%252Fdocs_service_history-1774716904447.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dea4cddab67391e236c76fd8dfd2f4551') HTTP/1.1" 204 0
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0973/20460973/docs_service_history-1774716904447.jpg?ixlib=js-3.8.0&auto=format&s=ea4cddab67391e236c76fd8dfd2f4551 saved to cache
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a6a10>
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F20460973%252Fdamage_scratches-1774715523618.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/20460973/damage_scratches-1774715523618.jpg saved to cache
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17747789.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/20460973/interior_dashboard-1774717521203.jpg> (referer: None)
2026-03-29 20:22:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7998cfe5-9b9c-5408-8866-2265342139a1 with identifier: 17747789
2026-03-29 20:22:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7998cfe5-9b9c-5408-8866-2265342139a1 with scrape type 1
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_front_driver-1774534608827.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_driver-1774534608827.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_rear_driver-1774534620664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_driver-1774534620664.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_front_passenger-1774535385486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_passenger-1774535385486.jpg not downloaded yet
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d212850>
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F20460973%252Finterior_dashboard-1774717521203.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/20460973/interior_dashboard-1774717521203.jpg saved to cache
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_rear_passenger-1774534658586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_passenger-1774534658586.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7789%252F17747789%252Finterior_front_seats-1774535977099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7789/17747789/interior_front_seats-1774535977099.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7789%252F17747789%252Finterior_rear_seats-1774536087255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7789/17747789/interior_rear_seats-1774536087255.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Finterior_dashboard-1774536042669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/interior_dashboard-1774536042669.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Finstrument_cluster-1774536082523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/instrument_cluster-1774536082523.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7789%252F17747789%252Finterior_boot-1774536022388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7789/17747789/interior_boot-1774536022388.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7789%252F17747789%252Fdocs_service_history-1774536307316.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da62af992773a4258fd4ed0598a974918%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7789/17747789/docs_service_history-1774536307316.jpg?ixlib=js-3.8.0&auto=format&s=a62af992773a4258fd4ed0598a974918 not downloaded yet
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/20460973/interior_front_seats-1774717506538.jpg> (referer: None)
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_passenger-1774715428175.jpg> (referer: None)
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6226570.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec15690>
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F20460973%252Finterior_front_seats-1774717506538.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/20460973/interior_front_seats-1774717506538.jpg saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cea8e90>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_rear_passenger-1774715428175.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_passenger-1774715428175.jpg saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:23:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a41575e-7263-555d-8fa2-0389cb95f3ba with identifier: 6226570
2026-03-29 20:23:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a41575e-7263-555d-8fa2-0389cb95f3ba with scrape type 1
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_front_driver-1774696588598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_driver-1774696588598.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_rear_driver-1774696608127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_driver-1774696608127.jpg not downloaded yet
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0973/20460973/interior_boot-1774716315169.jpg> (referer: None)
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_front_passenger-1774696637877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_passenger-1774696637877.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_rear_passenger-1774696622686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_passenger-1774696622686.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6570%252F6226570%252Finterior_front_seats-1774697330858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6570/6226570/interior_front_seats-1774697330858.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6570%252F6226570%252Finterior_rear_seats-1774697352296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6570/6226570/interior_rear_seats-1774697352296.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Finterior_dashboard-1774697431921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/interior_dashboard-1774697431921.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6570%252F6226570%252Finterior_boot-1774697388825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6570/6226570/interior_boot-1774697388825.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6570%252F6226570%252Fdocs_service_history-1774697678962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2433967ca2430d57796dcc182d6c3f26%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6570/6226570/docs_service_history-1774697678962.jpg?ixlib=js-3.8.0&auto=format&s=2433967ca2430d57796dcc182d6c3f26 not downloaded yet
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9e690>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F20460973%252Finterior_boot-1774716315169.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/20460973/interior_boot-1774716315169.jpg saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6570%252F6226570%252Fdamage_scratches-1774698457558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6570/6226570/damage_scratches-1774698457558.jpg not downloaded yet
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7789/17747789/docs_service_history-1774536307316.jpg?ixlib=js-3.8.0&auto=format&s=a62af992773a4258fd4ed0598a974918> (referer: None)
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7789/17747789/interior_boot-1774536022388.jpg> (referer: None)
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7789/17747789/instrument_cluster-1774536082523.jpg> (referer: None)
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c69790>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7789%252F17747789%252Fdocs_service_history-1774536307316.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da62af992773a4258fd4ed0598a974918') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7789/17747789/docs_service_history-1774536307316.jpg?ixlib=js-3.8.0&auto=format&s=a62af992773a4258fd4ed0598a974918 saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_driver-1774696588598.jpg> (referer: None)
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58e250>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7789%252F17747789%252Finterior_boot-1774536022388.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7789/17747789/interior_boot-1774536022388.jpg saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54ec10>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Finstrument_cluster-1774536082523.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/instrument_cluster-1774536082523.jpg saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6570/6226570/damage_scratches-1774698457558.jpg> (referer: None)
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3b0d0>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_front_driver-1774696588598.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_driver-1774696588598.jpg saved to cache
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d13d0>
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6570%252F6226570%252Fdamage_scratches-1774698457558.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6570/6226570/damage_scratches-1774698457558.jpg saved to cache
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6570/6226570/docs_service_history-1774697678962.jpg?ixlib=js-3.8.0&auto=format&s=2433967ca2430d57796dcc182d6c3f26> (referer: None)
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19569480.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6570/6226570/interior_boot-1774697388825.jpg> (referer: None)
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3b210>
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6570%252F6226570%252Fdocs_service_history-1774697678962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2433967ca2430d57796dcc182d6c3f26') HTTP/1.1" 204 0
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6570/6226570/docs_service_history-1774697678962.jpg?ixlib=js-3.8.0&auto=format&s=2433967ca2430d57796dcc182d6c3f26 saved to cache
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91bb2bed-db42-5f30-a982-5bd0ac8107a6 with identifier: 19569480
2026-03-29 20:23:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6 with scrape type 1
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9480%252F19569480%252Fexterior_front_driver-1771862382983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_front_driver-1771862382983.jpg not downloaded yet
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02ed90>
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6570%252F6226570%252Finterior_boot-1774697388825.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6570/6226570/interior_boot-1774697388825.jpg saved to cache
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9480%252F19569480%252Fexterior_rear_driver-1771862416395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_driver-1771862416395.jpg not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9480%252F19569480%252Fexterior_front_passenger-1771872519402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9480/19569480/exterior_front_passenger-1771872519402.jpg not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9480%252F19569480%252Fexterior_rear_passenger-1771862466620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_passenger-1771862466620.jpg not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Finterior_front_seats-1771862882414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/interior_front_seats-1771862882414.jpg not downloaded yet
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6570/6226570/interior_dashboard-1774697431921.jpg> (referer: None)
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Finterior_rear_seats-1771862906110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/interior_rear_seats-1771862906110.jpg not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9480%252F19569480%252Finterior_dashboard-1771872496496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9480/19569480/interior_dashboard-1771872496496.jpg not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Finterior_boot-1771862968564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/interior_boot-1771862968564.jpg not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9480%252F19569480%252Fdocs_service_history-1771863121168.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3ce23dd2cbffb21f32a702c67fa8310%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9480/19569480/docs_service_history-1771863121168.jpg?ixlib=js-3.8.0&auto=format&s=c3ce23dd2cbffb21f32a702c67fa8310 not downloaded yet
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Fdamage_scratches-1771862555551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/damage_scratches-1771862555551.jpg not downloaded yet
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_passenger-1774696622686.jpg> (referer: None)
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6570/6226570/interior_rear_seats-1774697352296.jpg> (referer: None)
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01310>
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Finterior_dashboard-1774697431921.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/interior_dashboard-1774697431921.jpg saved to cache
2026-03-29 20:23:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_passenger-1774696637877.jpg> (referer: None)
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d213110>
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_rear_passenger-1774696622686.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_passenger-1774696622686.jpg saved to cache
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e8a90>
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6570%252F6226570%252Finterior_rear_seats-1774697352296.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6570/6226570/interior_rear_seats-1774697352296.jpg saved to cache
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec76a10>
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_front_passenger-1774696637877.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_passenger-1774696637877.jpg saved to cache
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=720&page=20&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_passenger-1771862466620.jpg> (referer: None)
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/9480/19569480/docs_service_history-1771863121168.jpg?ixlib=js-3.8.0&auto=format&s=c3ce23dd2cbffb21f32a702c67fa8310> (referer: None)
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19584822
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719584822%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 19584822: 1
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19981352
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 14405517
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20490426
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20420305
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420305%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 20420305: 1
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20257737
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720257737%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 20257737: 1
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce382d0>
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9480%252F19569480%252Fexterior_rear_passenger-1771862466620.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_passenger-1771862466620.jpg saved to cache
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 18590519
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 18378231
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20357052
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20469592
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469592%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 20469592: 1
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19514188
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19747758
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 15938519
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20215486
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20230861
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720230861%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 20230861: 1
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 15219874
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20429518
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 14732982
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 7660198
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 13648117
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 17991269
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20487024
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 3181281
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 18078915
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20470010
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19430237
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719430237%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 19430237: 2
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e2a90>
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9480%252F19569480%252Fdocs_service_history-1771863121168.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3ce23dd2cbffb21f32a702c67fa8310') HTTP/1.1" 204 0
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9480/19569480/docs_service_history-1771863121168.jpg?ixlib=js-3.8.0&auto=format&s=c3ce23dd2cbffb21f32a702c67fa8310 saved to cache
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20422292
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422292%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 20422292: 1
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20373984
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20471256
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471256%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 20471256: 1
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6570/6226570/interior_front_seats-1774697330858.jpg> (referer: None)
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9480/19569480/damage_scratches-1771862555551.jpg> (referer: None)
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20283277
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20363739
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19842807
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 3792457
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273792457%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 3792457: 1
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 20423510
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19452760
2026-03-29 20:23:02 [motorway.uk] INFO: Found listing with ID: 19601308
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719601308%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [motorway.uk] INFO: Scrape type for 19601308: 1
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19564729.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9480/19569480/interior_dashboard-1771872496496.jpg> (referer: None)
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9480/19569480/interior_boot-1771862968564.jpg> (referer: None)
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9480/19569480/interior_rear_seats-1771862906110.jpg> (referer: None)
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12f810>
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6570%252F6226570%252Finterior_front_seats-1774697330858.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6570/6226570/interior_front_seats-1774697330858.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed71710>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Fdamage_scratches-1771862555551.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/damage_scratches-1771862555551.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 with identifier: 19564729
2026-03-29 20:23:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 with scrape type 1
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Fexterior_front_driver-1774698247180.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_driver-1774698247180.jpeg not downloaded yet
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d149e10>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9480%252F19569480%252Finterior_dashboard-1771872496496.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9480/19569480/interior_dashboard-1771872496496.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb0810>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Finterior_boot-1771862968564.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/interior_boot-1771862968564.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb10d0>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9480%252F19569480%252Finterior_rear_seats-1771862906110.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9480/19569480/interior_rear_seats-1771862906110.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Fexterior_rear_driver-1774698286101.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_rear_driver-1774698286101.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Fexterior_front_passenger-1774698255611.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_passenger-1774698255611.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4729%252F19564729%252F19564729-exterior_rear_passenger-modified-1774702841495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4729/19564729/19564729-exterior_rear_passenger-modified-1774702841495.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4729%252F19564729%252Finterior_front_seats-1774698580232.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4729/19564729/interior_front_seats-1774698580232.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4729%252F19564729%252Finterior_rear_seats-1774698743216.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4729/19564729/interior_rear_seats-1774698743216.jpeg not downloaded yet
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4729%252F19564729%252F19564729-interior_dashboard-modified-1774700287912.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4729/19564729/19564729-interior_dashboard-modified-1774700287912.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Finstrument_cluster-1774698755230.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/instrument_cluster-1774698755230.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4729%252F19564729%252Finterior_boot-1774698799302.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4729/19564729/interior_boot-1774698799302.jpeg not downloaded yet
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4729%252F19564729%252Fdocs_service_history-1774699547930.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35475421ad3febf821db638d59cece9f%27 HTTP/1.1" 200 None
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4729/19564729/docs_service_history-1774699547930.jpeg?ixlib=js-3.8.0&auto=format&s=35475421ad3febf821db638d59cece9f not downloaded yet
2026-03-29 20:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_driver-1774698247180.jpeg> (referer: None)
2026-03-29 20:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_rear_driver-1774698286101.jpeg> (referer: None)
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb7f90>
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Fexterior_front_driver-1774698247180.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_driver-1774698247180.jpeg saved to cache
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb6e10>
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Fexterior_rear_driver-1774698286101.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_rear_driver-1774698286101.jpeg saved to cache
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:04 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15207230) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4729/19564729/interior_boot-1774698799302.jpeg>.
2026-03-29 20:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4729/19564729/docs_service_history-1774699547930.jpeg?ixlib=js-3.8.0&auto=format&s=35475421ad3febf821db638d59cece9f> (referer: None)
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea45090>
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4729%252F19564729%252Fdocs_service_history-1774699547930.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35475421ad3febf821db638d59cece9f') HTTP/1.1" 204 0
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4729/19564729/docs_service_history-1774699547930.jpeg?ixlib=js-3.8.0&auto=format&s=35475421ad3febf821db638d59cece9f saved to cache
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:05 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4729/19564729/interior_boot-1774698799302.jpeg>.
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4729/19564729/instrument_cluster-1774698755230.jpeg> (referer: None)
2026-03-29 20:23:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:23:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:23:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00|\xe2\xa1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05m8\x00|\xd8\xaf\x00\x00\x00\x00'
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb03590>
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Finstrument_cluster-1774698755230.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/instrument_cluster-1774698755230.jpeg saved to cache
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:05 [scrapy.extensions.logstats] INFO: Crawled 198 pages (at 24 pages/min), scraped 159 items (at 21 items/min)
2026-03-29 20:23:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4729/19564729/interior_boot-1774698799302.jpeg> (referer: None)
2026-03-29 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15364589.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xe0}G\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\x8d\xf7\x00\xe0sU\x00\x00\x00\x00'
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb80fd0>
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4729%252F19564729%252Finterior_boot-1774698799302.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4729/19564729/interior_boot-1774698799302.jpeg saved to cache
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13105341.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d67acae-ad8f-50af-be54-2024b52137f3 with identifier: 15364589
2026-03-29 20:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d67acae-ad8f-50af-be54-2024b52137f3 with scrape type 1
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_front_driver-1774706418290.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_driver-1774706418290.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_rear_driver-1774706466312.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_driver-1774706466312.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_front_passenger-1774706441826.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_passenger-1774706441826.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_rear_passenger-1774706452009.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_passenger-1774706452009.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4589%252F15364589%252Finterior_front_seats-1774706710403.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4589/15364589/interior_front_seats-1774706710403.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4589%252F15364589%252Finterior_rear_seats-1774706827994.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4589/15364589/interior_rear_seats-1774706827994.jpeg not downloaded yet
2026-03-29 20:23:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 144db9b4-bd33-5bf7-9e64-d5dfc774490d with identifier: 13105341
2026-03-29 20:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d with scrape type 1
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5341%252F13105341%252Fexterior_front_driver-1774705367395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5341/13105341/exterior_front_driver-1774705367395.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4589%252F15364589%252F15364589-interior_dashboard-modified-1774707860158.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4589/15364589/15364589-interior_dashboard-modified-1774707860158.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Fexterior_rear_driver-1774702759581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_driver-1774702759581.jpg not downloaded yet
2026-03-29 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20021655.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Finstrument_cluster-1774706691775.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/instrument_cluster-1774706691775.jpeg not downloaded yet
2026-03-29 20:23:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Fexterior_front_passenger-1774702762523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_front_passenger-1774702762523.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4589%252F15364589%252Finterior_boot-1774706657392.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4589/15364589/interior_boot-1774706657392.jpeg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Fexterior_rear_passenger-1774702976058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_passenger-1774702976058.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4589%252F15364589%252Fdocs_service_history-1774707367297.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D855c09a61825b3b8558ca947c51ea0d8%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4589/15364589/docs_service_history-1774707367297.jpeg?ixlib=js-3.8.0&auto=format&s=855c09a61825b3b8558ca947c51ea0d8 not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5341%252F13105341%252Finterior_front_seats-1774703693608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5341/13105341/interior_front_seats-1774703693608.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5341%252F13105341%252Finterior_rear_seats-1774703687438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5341/13105341/interior_rear_seats-1774703687438.jpg not downloaded yet
2026-03-29 20:23:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3faf42d-c916-5684-8d73-f0634442562a with identifier: 20021655
2026-03-29 20:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3faf42d-c916-5684-8d73-f0634442562a with scrape type 1
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1655%252F20021655%252Fexterior_front_driver-1774696302944.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1655/20021655/exterior_front_driver-1774696302944.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Finterior_dashboard-1774703698536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/interior_dashboard-1774703698536.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Fexterior_rear_driver-1774693623785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_driver-1774693623785.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Finstrument_cluster-1774703709195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/instrument_cluster-1774703709195.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Fexterior_front_passenger-1774693605831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_front_passenger-1774693605831.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5341%252F13105341%252Finterior_boot-1774703691664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5341/13105341/interior_boot-1774703691664.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Fexterior_rear_passenger-1774693619758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_passenger-1774693619758.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5341%252F13105341%252Fdocs_service_history-1774703848613.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db98bd83077dc801fe1ed2ba937985c9b%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5341/13105341/docs_service_history-1774703848613.jpg?ixlib=js-3.8.0&auto=format&s=b98bd83077dc801fe1ed2ba937985c9b not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1655%252F20021655%252Finterior_front_seats-1774694612650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1655/20021655/interior_front_seats-1774694612650.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1655%252F20021655%252Finterior_rear_seats-1774694601074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1655/20021655/interior_rear_seats-1774694601074.jpg not downloaded yet
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Finterior_dashboard-1774694606430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/interior_dashboard-1774694606430.jpg not downloaded yet
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1655%252F20021655%252Finstrument_cluster-1774696266242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1655/20021655/instrument_cluster-1774696266242.jpg not downloaded yet
2026-03-29 20:23:07 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12686716) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4729/19564729/interior_front_seats-1774698580232.jpeg>.
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1655%252F20021655%252Finterior_boot-1774694607763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1655/20021655/interior_boot-1774694607763.jpg not downloaded yet
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1655%252F20021655%252Fdocs_service_history-1774695515997.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d6f1655c5df82a9d720db28b3142f61%27 HTTP/1.1" 200 None
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1655/20021655/docs_service_history-1774695515997.jpg?ixlib=js-3.8.0&auto=format&s=0d6f1655c5df82a9d720db28b3142f61 not downloaded yet
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4729/19564729/19564729-interior_dashboard-modified-1774700287912.jpeg> (referer: None)
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_driver-1774702759581.jpg> (referer: None)
2026-03-29 20:23:07 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11323180) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4729/19564729/interior_rear_seats-1774698743216.jpeg>.
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc03a50>
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4729%252F19564729%252F19564729-interior_dashboard-modified-1774700287912.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4729/19564729/19564729-interior_dashboard-modified-1774700287912.jpeg saved to cache
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc01e10>
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Fexterior_rear_driver-1774702759581.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_driver-1774702759581.jpg saved to cache
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:07 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4729/19564729/interior_front_seats-1774698580232.jpeg>.
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4729/19564729/interior_front_seats-1774698580232.jpeg> (referer: None)
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4729/19564729/19564729-exterior_rear_passenger-modified-1774702841495.jpeg> (referer: None)
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb9\xd1\x02\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xc4z\x00\xb9\xc7\x10\x00\x00\x00\x00'
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d185790>
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4729%252F19564729%252Finterior_front_seats-1774698580232.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4729/19564729/interior_front_seats-1774698580232.jpeg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac8c90>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4729%252F19564729%252F19564729-exterior_rear_passenger-modified-1774702841495.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4729/19564729/19564729-exterior_rear_passenger-modified-1774702841495.jpeg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1655/20021655/docs_service_history-1774695515997.jpg?ixlib=js-3.8.0&auto=format&s=0d6f1655c5df82a9d720db28b3142f61> (referer: None)
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1655/20021655/interior_boot-1774694607763.jpg> (referer: None)
2026-03-29 20:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t\x0c'
2026-03-29 20:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:23:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:23:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc031d0>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1655%252F20021655%252Fdocs_service_history-1774695515997.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d6f1655c5df82a9d720db28b3142f61') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1655/20021655/docs_service_history-1774695515997.jpg?ixlib=js-3.8.0&auto=format&s=0d6f1655c5df82a9d720db28b3142f61 saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc00350>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1655%252F20021655%252Finterior_boot-1774694607763.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1655/20021655/interior_boot-1774694607763.jpg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1655/20021655/instrument_cluster-1774696266242.jpg> (referer: None)
2026-03-29 20:23:08 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4729/19564729/interior_rear_seats-1774698743216.jpeg>.
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1655/20021655/interior_front_seats-1774694612650.jpg> (referer: None)
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1655/20021655/interior_dashboard-1774694606430.jpg> (referer: None)
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4729/19564729/interior_rear_seats-1774698743216.jpeg> (referer: None)
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1655/20021655/interior_rear_seats-1774694601074.jpg> (referer: None)
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced6650>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1655%252F20021655%252Finstrument_cluster-1774696266242.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1655/20021655/instrument_cluster-1774696266242.jpg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e929010>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1655%252F20021655%252Finterior_front_seats-1774694612650.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1655/20021655/interior_front_seats-1774694612650.jpg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadec50>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Finterior_dashboard-1774694606430.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/interior_dashboard-1774694606430.jpg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xa5\xff?\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xc7\xed\x00\xa5\xf5M\x00\x00\x00\x00'
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc1430a010>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4729%252F19564729%252Finterior_rear_seats-1774698743216.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4729/19564729/interior_rear_seats-1774698743216.jpeg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cab38d0>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1655%252F20021655%252Finterior_rear_seats-1774694601074.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1655/20021655/interior_rear_seats-1774694601074.jpg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_passenger-1774693619758.jpg> (referer: None)
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5341/13105341/docs_service_history-1774703848613.jpg?ixlib=js-3.8.0&auto=format&s=b98bd83077dc801fe1ed2ba937985c9b> (referer: None)
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec67250>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Fexterior_rear_passenger-1774693619758.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_passenger-1774693619758.jpg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\xd0\x0c'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: unknown (544) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\xa0\t'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: unknown (545) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: unknown (546) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: unknown (547) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: unknown (548) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: unknown (549) - type: string (2) Tag Location: 106 - Data Location: 254 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 286 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 142 - Data Location: 318 - value: b'Xiaomi\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 325 - value: b'M2101K7BNY\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 336 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 190 - Data Location: 368 - value: b'2026:01:02 17:23:35\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x94\x01\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x7f\x0c\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 238 - Data Location: 388 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 250 - Data Location: 396 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac8d10>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5341%252F13105341%252Fdocs_service_history-1774703848613.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db98bd83077dc801fe1ed2ba937985c9b') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5341/13105341/docs_service_history-1774703848613.jpg?ixlib=js-3.8.0&auto=format&s=b98bd83077dc801fe1ed2ba937985c9b saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_driver-1774693623785.jpg> (referer: None)
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5341/13105341/interior_boot-1774703691664.jpg> (referer: None)
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5341/13105341/interior_dashboard-1774703698536.jpg> (referer: None)
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_front_passenger-1774693605831.jpg> (referer: None)
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06b3d0>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Fexterior_rear_driver-1774693623785.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_driver-1774693623785.jpg saved to cache
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'Xiaomi\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:14:37\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'M2101K7BNY\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cab0650>
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5341%252F13105341%252Finterior_boot-1774703691664.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5341/13105341/interior_boot-1774703691664.jpg saved to cache
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'Xiaomi\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:14:22\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'M2101K7BNY\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d184650>
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Finterior_dashboard-1774703698536.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/interior_dashboard-1774703698536.jpg saved to cache
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc1430ac10>
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1655%252F20021655%252Fexterior_front_passenger-1774693605831.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_front_passenger-1774693605831.jpg saved to cache
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5341/13105341/instrument_cluster-1774703709195.jpg> (referer: None)
2026-03-29 20:23:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=756&page=21&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'Xiaomi\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:12:34\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'M2101K7BNY\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:23:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf001d0>
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Finstrument_cluster-1774703709195.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/instrument_cluster-1774703709195.jpg saved to cache
2026-03-29 20:23:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 19444118
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 20486974
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 20486509
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 14040355
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714040355%27 HTTP/1.1" 200 None
2026-03-29 20:23:10 [motorway.uk] INFO: Scrape type for 14040355: 1
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 17809843
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 20270906
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 9667311
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279667311%27 HTTP/1.1" 200 None
2026-03-29 20:23:10 [motorway.uk] INFO: Scrape type for 9667311: 1
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 19797838
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 20486919
2026-03-29 20:23:10 [motorway.uk] INFO: Found listing with ID: 20406062
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 18135215
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20348082
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 19815321
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719815321%27 HTTP/1.1" 200 None
2026-03-29 20:23:11 [motorway.uk] INFO: Scrape type for 19815321: 1
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 18899297
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20382953
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382953%27 HTTP/1.1" 200 None
2026-03-29 20:23:11 [motorway.uk] INFO: Scrape type for 20382953: 1
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 15048808
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20376604
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 19669683
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 16614089
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20281844
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20472398
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20463285
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 10521418
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20325744
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 7322331
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 6590662
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276590662%27 HTTP/1.1" 200 None
2026-03-29 20:23:11 [motorway.uk] INFO: Scrape type for 6590662: 1
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 12561164
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20346563
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 18746892
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718746892%27 HTTP/1.1" 200 None
2026-03-29 20:23:11 [motorway.uk] INFO: Scrape type for 18746892: 1
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 18935928
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 11445648
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20471200
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20259315
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 18569454
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718569454%27 HTTP/1.1" 200 None
2026-03-29 20:23:11 [motorway.uk] INFO: Scrape type for 18569454: 1
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 19681726
2026-03-29 20:23:11 [motorway.uk] INFO: Found listing with ID: 20483853
2026-03-29 20:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1655/20021655/exterior_front_driver-1774696302944.jpg> (referer: None)
2026-03-29 20:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_passenger-1774702976058.jpg> (referer: None)
2026-03-29 20:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5341/13105341/interior_rear_seats-1774703687438.jpg> (referer: None)
2026-03-29 20:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5341/13105341/interior_front_seats-1774703693608.jpg> (referer: None)
2026-03-29 20:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4589/15364589/interior_boot-1774706657392.jpeg> (referer: None)
2026-03-29 20:23:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed90ed0>
2026-03-29 20:23:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1655%252F20021655%252Fexterior_front_driver-1774696302944.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1655/20021655/exterior_front_driver-1774696302944.jpg saved to cache
2026-03-29 20:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3faf42d-c916-5684-8d73-f0634442562a
2026-03-29 20:23:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3faf42d-c916-5684-8d73-f0634442562a, skipping ID generation
2026-03-29 20:23:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3faf42d-c916-5684-8d73-f0634442562a with scrape type 1
2026-03-29 20:23:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3faf42d-c916-5684-8d73-f0634442562a sending to next pipeline
2026-03-29 20:23:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c3faf42d-c916-5684-8d73-f0634442562a, identifier: 20021655
2026-03-29 20:23:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c3faf42d-c916-5684-8d73-f0634442562a with identifier: 20021655
2026-03-29 20:23:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c3faf42d-c916-5684-8d73-f0634442562a with identifier: 20021655
2026-03-29 20:23:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c3faf42d-c916-5684-8d73-f0634442562a with identifier: 20021655 to the API
2026-03-29 20:23:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1655/20021655/exterior_front_driver-1774696302944.jpg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c3faf42d-c916-5684-8d73-f0634442562a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MD73 WXX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20021655',
'listing': 'auction',
'location': 'Greater Manchester Littleborough',
'make': 'Audi',
'model': 'S3',
'odometer': 12500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2354459,
'Height': 2531,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1655/20021655/exterior_front_driver-1774696302944.jpg',
'Width': 3375},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2319638,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_driver-1774693623785.jpg',
'Width': 3643},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1453420,
'Height': 2378,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_front_passenger-1774693605831.jpg',
'Width': 3171},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593418,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1655/20021655/exterior_rear_passenger-1774693619758.jpg',
'Width': 3095},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465265,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1655/20021655/interior_front_seats-1774694612650.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1878875,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1655/20021655/interior_rear_seats-1774694601074.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201597,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1655/20021655/interior_dashboard-1774694606430.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557880,
'Height': 1703,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1655/20021655/instrument_cluster-1774696266242.jpg',
'Width': 2271},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2449393,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1655/20021655/interior_boot-1774694607763.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3faf42d-c916-5684-8d73-f0634442562a/c3faf42d-c916-5684-8d73-f0634442562a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301810,
'Height': 2316,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1655/20021655/docs_service_history-1774695515997.jpg?ixlib=js-3.8.0&auto=format&s=0d6f1655c5df82a9d720db28b3142f61',
'Width': 1080}],
'price': 34250,
'price_includes_vat': False,
'registration_date': '2023-12-22',
'seats_number': None,
'seller_name': None,
'title': 'Audi S3 Black Edition TFSI Quat SA',
'transmission': 'automatic',
'trim': 'Black Edition TFSI Quat SA',
'vin': 'WAUZZZGY0RA034148',
'year': 2023}
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720021655%27 HTTP/1.1" 200 None
2026-03-29 20:23:12 [motorway.uk] INFO: Saving data for 20021655: {'created_time': 1774815792.153415, 'last_price_update_time': 1774815792.153427, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20021655') HTTP/1.1" 204 0
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e084dd0>
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Fexterior_rear_passenger-1774702976058.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_passenger-1774702976058.jpg saved to cache
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'Xiaomi\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:14:01\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'M2101K7BNY\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24d7d0>
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5341%252F13105341%252Finterior_rear_seats-1774703687438.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5341/13105341/interior_rear_seats-1774703687438.jpg saved to cache
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'Xiaomi\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:13:37\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'M2101K7BNY\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7f410>
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5341%252F13105341%252Finterior_front_seats-1774703693608.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5341/13105341/interior_front_seats-1774703693608.jpg saved to cache
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003K\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x1d\xdf\x003A>\x00\x00\x00\x00'
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec66c90>
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4589%252F15364589%252Finterior_boot-1774706657392.jpeg') HTTP/1.1" 204 0
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4589/15364589/interior_boot-1774706657392.jpeg saved to cache
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:23:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4589/15364589/docs_service_history-1774707367297.jpeg?ixlib=js-3.8.0&auto=format&s=855c09a61825b3b8558ca947c51ea0d8> (referer: None)
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24e2d0>
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4589%252F15364589%252Fdocs_service_history-1774707367297.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D855c09a61825b3b8558ca947c51ea0d8') HTTP/1.1" 204 0
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4589/15364589/docs_service_history-1774707367297.jpeg?ixlib=js-3.8.0&auto=format&s=855c09a61825b3b8558ca947c51ea0d8 saved to cache
2026-03-29 20:23:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:23:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3792457.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798820ef-ed11-53e2-838e-8058f43aa181 with identifier: 3792457
2026-03-29 20:23:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798820ef-ed11-53e2-838e-8058f43aa181 with scrape type 1
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Fexterior_front_driver-1774708831399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_driver-1774708831399.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2457%252F3792457%252Fexterior_rear_driver-1774708842553.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2457/3792457/exterior_rear_driver-1774708842553.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Fexterior_front_passenger-1774707315580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_passenger-1774707315580.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Fexterior_rear_passenger-1774707316990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_rear_passenger-1774707316990.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2457%252F3792457%252Finterior_front_seats-1774707736535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2457/3792457/interior_front_seats-1774707736535.jpg not downloaded yet
2026-03-29 20:23:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.525(s), this was the 1st time calling it.
2026-03-29 20:23:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.017786900878476 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Finterior_dashboard-1774707778224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/interior_dashboard-1774707778224.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Finstrument_cluster-1774707765326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/instrument_cluster-1774707765326.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2457%252F3792457%252Finterior_boot-1774708684757.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2457/3792457/interior_boot-1774708684757.jpg not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2457%252F3792457%252Fdocs_service_history-1774708752817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De243fa8eb5c2f445f1c7e98ead254b63%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2457/3792457/docs_service_history-1774708752817.jpg?ixlib=js-3.8.0&auto=format&s=e243fa8eb5c2f445f1c7e98ead254b63 not downloaded yet
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2457%252F3792457%252Fdamage_dents-1774707350548.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2457/3792457/damage_dents-1774707350548.jpg not downloaded yet
2026-03-29 20:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471256.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1195f0a-264f-56e1-b005-c5ed3e01abbf with identifier: 20471256
2026-03-29 20:23:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1195f0a-264f-56e1-b005-c5ed3e01abbf with scrape type 1
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1256%252F20471256%252Fexterior_front_driver-1774696887685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_driver-1774696887685.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1256%252F20471256%252Fexterior_rear_driver-1774696899121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1256/20471256/exterior_rear_driver-1774696899121.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1256%252F20471256%252Fexterior_front_passenger-1774696920234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_passenger-1774696920234.jpg not downloaded yet
2026-03-29 20:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2457/3792457/damage_dents-1774707350548.jpg> (referer: None)
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20471256%252Fexterior_rear_passenger-1774693908956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20471256/exterior_rear_passenger-1774693908956.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20471256%252Finterior_front_seats-1774694528222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20471256/interior_front_seats-1774694528222.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20471256%252Finterior_rear_seats-1774694560750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20471256/interior_rear_seats-1774694560750.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20471256%252Finterior_dashboard-1774616620805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20471256/interior_dashboard-1774616620805.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20471256%252Finstrument_cluster-1774617477503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20471256/instrument_cluster-1774617477503.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20471256%252Finterior_boot-1774616774976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20471256/interior_boot-1774616774976.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1256%252F20471256%252Fdocs_service_history-1774695083285.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da4668ecaf2057adf91f6d32b0d127301%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1256/20471256/docs_service_history-1774695083285.jpg?ixlib=js-3.8.0&auto=format&s=a4668ecaf2057adf91f6d32b0d127301 not downloaded yet
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7c9510>
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2457%252F3792457%252Fdamage_dents-1774707350548.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2457/3792457/damage_dents-1774707350548.jpg saved to cache
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_passenger-1774696920234.jpg> (referer: None)
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a2c10>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1256%252F20471256%252Fexterior_front_passenger-1774696920234.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_passenger-1774696920234.jpg saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1256/20471256/docs_service_history-1774695083285.jpg?ixlib=js-3.8.0&auto=format&s=a4668ecaf2057adf91f6d32b0d127301> (referer: None)
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20471256/interior_boot-1774616774976.jpg> (referer: None)
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d101550>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1256%252F20471256%252Fdocs_service_history-1774695083285.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da4668ecaf2057adf91f6d32b0d127301') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1256/20471256/docs_service_history-1774695083285.jpg?ixlib=js-3.8.0&auto=format&s=a4668ecaf2057adf91f6d32b0d127301 saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00&'
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2ac1d0>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20471256%252Finterior_boot-1774616774976.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20471256/interior_boot-1774616774976.jpg saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20471256/instrument_cluster-1774617477503.jpg> (referer: None)
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00&'
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1162d0>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20471256%252Finstrument_cluster-1774617477503.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20471256/instrument_cluster-1774617477503.jpg saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20471256/interior_dashboard-1774616620805.jpg> (referer: None)
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00&'
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e6dd0>
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20471256%252Finterior_dashboard-1774616620805.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20471256/interior_dashboard-1774616620805.jpg saved to cache
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4393703.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:23:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66eb0a69-ece0-5645-8641-7684019cc552 with identifier: 4393703
2026-03-29 20:23:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66eb0a69-ece0-5645-8641-7684019cc552 with scrape type 1
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_front_driver-1774711305553.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_driver-1774711305553.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_rear_driver-1774711283073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_driver-1774711283073.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_front_passenger-1774711300799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_passenger-1774711300799.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_rear_passenger-1774711292513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_passenger-1774711292513.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Finterior_front_seats-1774711578833.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/interior_front_seats-1774711578833.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Finterior_rear_seats-1774711573001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/interior_rear_seats-1774711573001.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3703%252F4393703%252Finterior_dashboard-1774715502958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3703/4393703/interior_dashboard-1774715502958.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Finstrument_cluster-1774711652276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/instrument_cluster-1774711652276.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Finterior_boot-1774711617688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/interior_boot-1774711617688.jpg not downloaded yet
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Fdamage_scratches-1774711357030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/damage_scratches-1774711357030.jpg not downloaded yet
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20471256/interior_rear_seats-1774694560750.jpg> (referer: None)
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d161590>
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20471256%252Finterior_rear_seats-1774694560750.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20471256/interior_rear_seats-1774694560750.jpg saved to cache
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20471256/interior_front_seats-1774694528222.jpg> (referer: None)
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d1650>
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20471256%252Finterior_front_seats-1774694528222.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20471256/interior_front_seats-1774694528222.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3703/4393703/damage_scratches-1774711357030.jpg> (referer: None)
2026-03-29 20:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3703/4393703/interior_boot-1774711617688.jpg> (referer: None)
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9a1490>
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Fdamage_scratches-1774711357030.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/damage_scratches-1774711357030.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced6e10>
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Finterior_boot-1774711617688.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/interior_boot-1774711617688.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3703/4393703/instrument_cluster-1774711652276.jpg> (referer: None)
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21ea50>
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Finstrument_cluster-1774711652276.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/instrument_cluster-1774711652276.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3703/4393703/interior_dashboard-1774715502958.jpg> (referer: None)
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d160710>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3703%252F4393703%252Finterior_dashboard-1774715502958.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3703/4393703/interior_dashboard-1774715502958.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3703/4393703/interior_rear_seats-1774711573001.jpg> (referer: None)
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d773b10>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Finterior_rear_seats-1774711573001.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/interior_rear_seats-1774711573001.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_passenger-1774711292513.jpg> (referer: None)
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3703/4393703/interior_front_seats-1774711578833.jpg> (referer: None)
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=792&page=22&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9a0e10>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_rear_passenger-1774711292513.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_passenger-1774711292513.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ee650>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3703%252F4393703%252Finterior_front_seats-1774711578833.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3703/4393703/interior_front_seats-1774711578833.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20385482
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 14497960
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20393358
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20217991
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720217991%27 HTTP/1.1" 200 None
2026-03-29 20:23:22 [motorway.uk] INFO: Scrape type for 20217991: 1
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20383556
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20485756
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485756%27 HTTP/1.1" 200 None
2026-03-29 20:23:22 [motorway.uk] INFO: Scrape type for 20485756: 1
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 19413267
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 19288331
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20462610
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20490179
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20486724
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20489344
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20348979
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 14956280
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 18941047
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 13723227
2026-03-29 20:23:22 [motorway.uk] INFO: Found listing with ID: 20423398
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423398%27 HTTP/1.1" 200 None
2026-03-29 20:23:22 [motorway.uk] INFO: Scrape type for 20423398: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20464480
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464480%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 20464480: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20471522
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471522%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 20471522: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 8915220
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278915220%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 8915220: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20476962
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476962%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 20476962: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 17749520
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 15294916
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715294916%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 15294916: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20018421
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20405344
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405344%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 20405344: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20465616
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465616%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Scrape type for 20465616: 1
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 12468788
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20416075
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20337017
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 5750587
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20426574
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20428130
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20480796
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20477490
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 20165932
2026-03-29 20:23:23 [motorway.uk] INFO: Found listing with ID: 19570678
2026-03-29 20:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_driver-1774711305553.jpg> (referer: None)
2026-03-29 20:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_passenger-1774711300799.jpg> (referer: None)
2026-03-29 20:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_driver-1774711283073.jpg> (referer: None)
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8e410>
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_front_driver-1774711305553.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_driver-1774711305553.jpg saved to cache
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c251210>
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_front_passenger-1774711300799.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_passenger-1774711300799.jpg saved to cache
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2de10>
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3703%252F4393703%252Fexterior_rear_driver-1774711283073.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_driver-1774711283073.jpg saved to cache
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66eb0a69-ece0-5645-8641-7684019cc552
2026-03-29 20:23:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66eb0a69-ece0-5645-8641-7684019cc552, skipping ID generation
2026-03-29 20:23:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66eb0a69-ece0-5645-8641-7684019cc552 with scrape type 1
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66eb0a69-ece0-5645-8641-7684019cc552 sending to next pipeline
2026-03-29 20:23:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 66eb0a69-ece0-5645-8641-7684019cc552, identifier: 4393703
2026-03-29 20:23:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 66eb0a69-ece0-5645-8641-7684019cc552 with identifier: 4393703
2026-03-29 20:23:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 66eb0a69-ece0-5645-8641-7684019cc552 with identifier: 4393703
2026-03-29 20:23:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 66eb0a69-ece0-5645-8641-7684019cc552 with identifier: 4393703 to the API
2026-03-29 20:23:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_driver-1774711283073.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '66eb0a69-ece0-5645-8641-7684019cc552',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'XX15 COX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4393703',
'listing': 'auction',
'location': 'Kent Swanley',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 50460,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1497340,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_driver-1774711305553.jpg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581511,
'Height': 2664,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_driver-1774711283073.jpg',
'Width': 3552},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548094,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_front_passenger-1774711300799.jpg',
'Width': 3478},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1226679,
'Height': 2375,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3703/4393703/exterior_rear_passenger-1774711292513.jpg',
'Width': 3166},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3074815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3703/4393703/interior_front_seats-1774711578833.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3051531,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3703/4393703/interior_rear_seats-1774711573001.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2140807,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3703/4393703/interior_dashboard-1774715502958.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2223611,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3703/4393703/instrument_cluster-1774711652276.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3202739,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3703/4393703/interior_boot-1774711617688.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66eb0a69-ece0-5645-8641-7684019cc552/66eb0a69-ece0-5645-8641-7684019cc552_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1996304,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3703/4393703/damage_scratches-1774711357030.jpg',
'Width': 4032}],
'price': 4321,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa Energy',
'transmission': 'manual',
'trim': 'Energy',
'vin': 'W0V0XEP08K6000501',
'year': 2018}
2026-03-29 20:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274393703%27 HTTP/1.1" 200 None
2026-03-29 20:23:24 [motorway.uk] INFO: Saving data for 4393703: {'created_time': 1774815804.297131, 'last_price_update_time': 1774815804.297141, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4393703') HTTP/1.1" 204 0
2026-03-29 20:23:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.282(s), this was the 1st time calling it.
2026-03-29 20:23:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.381439198203806 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:23:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18569454.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0a5a248-13a7-5f68-a727-16eccfbebc32 with identifier: 18569454
2026-03-29 20:23:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a5a248-13a7-5f68-a727-16eccfbebc32 with scrape type 1
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_front_driver-1774633667392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_driver-1774633667392.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_rear_driver-1774633692502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_driver-1774633692502.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_front_passenger-1774633736389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_passenger-1774633736389.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_rear_passenger-1774633711688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_passenger-1774633711688.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Finterior_front_seats-1774634032956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/interior_front_seats-1774634032956.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Finterior_rear_seats-1774634043324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/interior_rear_seats-1774634043324.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Finterior_dashboard-1774634081202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/interior_dashboard-1774634081202.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Finterior_boot-1774634209020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/interior_boot-1774634209020.jpg not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9454%252F18569454%252Fdocs_service_history-1774634372854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6f4892573ae3e4c6475256a93de2d7e%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9454/18569454/docs_service_history-1774634372854.jpg?ixlib=js-3.8.0&auto=format&s=b6f4892573ae3e4c6475256a93de2d7e not downloaded yet
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Fdamage_scratches-1774633791408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/damage_scratches-1774633791408.jpg not downloaded yet
2026-03-29 20:23:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:23:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20401950.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcaf28be-bb73-570f-8ce8-013bd69ded61 with identifier: 20401950
2026-03-29 20:23:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcaf28be-bb73-570f-8ce8-013bd69ded61 with scrape type 1
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_front_driver-1774702080178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_driver-1774702080178.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_rear_driver-1774702102182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_driver-1774702102182.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_front_passenger-1774702207954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_passenger-1774702207954.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_rear_passenger-1774702117648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_passenger-1774702117648.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1950%252F20401950%252Finterior_front_seats-1774702519777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1950/20401950/interior_front_seats-1774702519777.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Finterior_dashboard-1774702577834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/interior_dashboard-1774702577834.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1950%252F20401950%252Finterior_boot-1774702572783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1950/20401950/interior_boot-1774702572783.jpg not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1950%252F20401950%252Fdocs_service_history-1774702770892.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D496e04860b856a3dadecb21c3f5ac1c2%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702770892.jpg?ixlib=js-3.8.0&auto=format&s=496e04860b856a3dadecb21c3f5ac1c2 not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1950%252F20401950%252Fdocs_service_history-1774702791375.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd11da6e9e4f353cf250acdbf526bd25c%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702791375.jpg?ixlib=js-3.8.0&auto=format&s=d11da6e9e4f353cf250acdbf526bd25c not downloaded yet
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1950%252F20401950%252Fdocs_service_history-1774702792878.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4f365654915750e14e60e8d07850d7ef%27 HTTP/1.1" 200 None
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702792878.jpg?ixlib=js-3.8.0&auto=format&s=4f365654915750e14e60e8d07850d7ef not downloaded yet
2026-03-29 20:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/18569454/damage_scratches-1774633791408.jpg> (referer: None)
2026-03-29 20:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702792878.jpg?ixlib=js-3.8.0&auto=format&s=4f365654915750e14e60e8d07850d7ef> (referer: None)
2026-03-29 20:23:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:23:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0418d0>
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Fdamage_scratches-1774633791408.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/damage_scratches-1774633791408.jpg saved to cache
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54f590>
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1950%252F20401950%252Fdocs_service_history-1774702792878.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4f365654915750e14e60e8d07850d7ef') HTTP/1.1" 204 0
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702792878.jpg?ixlib=js-3.8.0&auto=format&s=4f365654915750e14e60e8d07850d7ef saved to cache
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702791375.jpg?ixlib=js-3.8.0&auto=format&s=d11da6e9e4f353cf250acdbf526bd25c> (referer: None)
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec2a810>
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1950%252F20401950%252Fdocs_service_history-1774702791375.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd11da6e9e4f353cf250acdbf526bd25c') HTTP/1.1" 204 0
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702791375.jpg?ixlib=js-3.8.0&auto=format&s=d11da6e9e4f353cf250acdbf526bd25c saved to cache
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702770892.jpg?ixlib=js-3.8.0&auto=format&s=496e04860b856a3dadecb21c3f5ac1c2> (referer: None)
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e30d0>
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1950%252F20401950%252Fdocs_service_history-1774702770892.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D496e04860b856a3dadecb21c3f5ac1c2') HTTP/1.1" 204 0
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702770892.jpg?ixlib=js-3.8.0&auto=format&s=496e04860b856a3dadecb21c3f5ac1c2 saved to cache
2026-03-29 20:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1950/20401950/interior_boot-1774702572783.jpg> (referer: None)
2026-03-29 20:23:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d146650>
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1950%252F20401950%252Finterior_boot-1774702572783.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1950/20401950/interior_boot-1774702572783.jpg saved to cache
2026-03-29 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1950/20401950/interior_dashboard-1774702577834.jpg> (referer: None)
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d555e90>
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Finterior_dashboard-1774702577834.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/interior_dashboard-1774702577834.jpg saved to cache
2026-03-29 20:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1950/20401950/interior_front_seats-1774702519777.jpg> (referer: None)
2026-03-29 20:23:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d144690>
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1950%252F20401950%252Finterior_front_seats-1774702519777.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1950/20401950/interior_front_seats-1774702519777.jpg saved to cache
2026-03-29 20:23:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_passenger-1774702117648.jpg> (referer: None)
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edcec10>
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_rear_passenger-1774702117648.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_passenger-1774702117648.jpg saved to cache
2026-03-29 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_passenger-1774702207954.jpg> (referer: None)
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d040f10>
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_front_passenger-1774702207954.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_passenger-1774702207954.jpg saved to cache
2026-03-29 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_driver-1774702102182.jpg> (referer: None)
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edce950>
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_rear_driver-1774702102182.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_driver-1774702102182.jpg saved to cache
2026-03-29 20:23:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_driver-1774702080178.jpg> (referer: None)
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ef0d0>
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1950%252F20401950%252Fexterior_front_driver-1774702080178.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_driver-1774702080178.jpg saved to cache
2026-03-29 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcaf28be-bb73-570f-8ce8-013bd69ded61
2026-03-29 20:23:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcaf28be-bb73-570f-8ce8-013bd69ded61, skipping ID generation
2026-03-29 20:23:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcaf28be-bb73-570f-8ce8-013bd69ded61 with scrape type 1
2026-03-29 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcaf28be-bb73-570f-8ce8-013bd69ded61 sending to next pipeline
2026-03-29 20:23:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fcaf28be-bb73-570f-8ce8-013bd69ded61, identifier: 20401950
2026-03-29 20:23:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fcaf28be-bb73-570f-8ce8-013bd69ded61 with identifier: 20401950
2026-03-29 20:23:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fcaf28be-bb73-570f-8ce8-013bd69ded61 with identifier: 20401950
2026-03-29 20:23:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fcaf28be-bb73-570f-8ce8-013bd69ded61 with identifier: 20401950 to the API
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_driver-1774702080178.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '4.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fcaf28be-bb73-570f-8ce8-013bd69ded61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YJ10 FHM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20401950',
'listing': 'auction',
'location': 'Kent Maidstone',
'make': 'Aston Martin',
'model': 'Vantage',
'odometer': 10055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2752501,
'Height': 2898,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_driver-1774702080178.jpg',
'Width': 3864},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1919950,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_driver-1774702102182.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495147,
'Height': 2806,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_front_passenger-1774702207954.jpg',
'Width': 3741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213787,
'Height': 2525,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1950/20401950/exterior_rear_passenger-1774702117648.jpg',
'Width': 3367},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3729020,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1950/20401950/interior_front_seats-1774702519777.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1610973,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1950/20401950/interior_dashboard-1774702577834.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4508289,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1950/20401950/interior_boot-1774702572783.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1454321,
'Height': 3982,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702770892.jpg?ixlib=js-3.8.0&auto=format&s=496e04860b856a3dadecb21c3f5ac1c2',
'Width': 6147},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393910,
'Height': 1549,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702791375.jpg?ixlib=js-3.8.0&auto=format&s=d11da6e9e4f353cf250acdbf526bd25c',
'Width': 3195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcaf28be-bb73-570f-8ce8-013bd69ded61/fcaf28be-bb73-570f-8ce8-013bd69ded61_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460507,
'Height': 1953,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1950/20401950/docs_service_history-1774702792878.jpg?ixlib=js-3.8.0&auto=format&s=4f365654915750e14e60e8d07850d7ef',
'Width': 3669}],
'price': 36167,
'price_includes_vat': False,
'registration_date': '2010-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Aston Martin Vantage V8 Auto',
'transmission': 'automatic',
'trim': 'V8 Auto',
'vin': 'SCFEEBAC8AGC13951',
'year': 2010}
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401950%27 HTTP/1.1" 200 None
2026-03-29 20:23:47 [motorway.uk] INFO: Saving data for 20401950: {'created_time': 1774815827.542687, 'last_price_update_time': 1774815827.542697, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20401950') HTTP/1.1" 204 0
2026-03-29 20:23:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9454/18569454/docs_service_history-1774634372854.jpg?ixlib=js-3.8.0&auto=format&s=b6f4892573ae3e4c6475256a93de2d7e> (referer: None)
2026-03-29 20:23:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e2350>
2026-03-29 20:23:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9454%252F18569454%252Fdocs_service_history-1774634372854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db6f4892573ae3e4c6475256a93de2d7e') HTTP/1.1" 204 0
2026-03-29 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9454/18569454/docs_service_history-1774634372854.jpg?ixlib=js-3.8.0&auto=format&s=b6f4892573ae3e4c6475256a93de2d7e saved to cache
2026-03-29 20:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/18569454/interior_boot-1774634209020.jpg> (referer: None)
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edcf550>
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Finterior_boot-1774634209020.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/interior_boot-1774634209020.jpg saved to cache
2026-03-29 20:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/18569454/interior_dashboard-1774634081202.jpg> (referer: None)
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d043150>
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Finterior_dashboard-1774634081202.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/interior_dashboard-1774634081202.jpg saved to cache
2026-03-29 20:23:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/18569454/interior_rear_seats-1774634043324.jpg> (referer: None)
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ece10>
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Finterior_rear_seats-1774634043324.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/interior_rear_seats-1774634043324.jpg saved to cache
2026-03-29 20:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/18569454/interior_front_seats-1774634032956.jpg> (referer: None)
2026-03-29 20:23:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54e450>
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F18569454%252Finterior_front_seats-1774634032956.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/18569454/interior_front_seats-1774634032956.jpg saved to cache
2026-03-29 20:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_passenger-1774633711688.jpg> (referer: None)
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1a9b50>
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_rear_passenger-1774633711688.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_passenger-1774633711688.jpg saved to cache
2026-03-29 20:23:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_passenger-1774633736389.jpg> (referer: None)
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2bc850>
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_front_passenger-1774633736389.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_passenger-1774633736389.jpg saved to cache
2026-03-29 20:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_driver-1774633692502.jpg> (referer: None)
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d772090>
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_rear_driver-1774633692502.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_driver-1774633692502.jpg saved to cache
2026-03-29 20:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_driver-1774633667392.jpg> (referer: None)
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5574d0>
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F18569454%252Fexterior_front_driver-1774633667392.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_driver-1774633667392.jpg saved to cache
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0a5a248-13a7-5f68-a727-16eccfbebc32
2026-03-29 20:23:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0a5a248-13a7-5f68-a727-16eccfbebc32, skipping ID generation
2026-03-29 20:23:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a5a248-13a7-5f68-a727-16eccfbebc32 with scrape type 1
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0a5a248-13a7-5f68-a727-16eccfbebc32 sending to next pipeline
2026-03-29 20:23:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d0a5a248-13a7-5f68-a727-16eccfbebc32, identifier: 18569454
2026-03-29 20:23:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d0a5a248-13a7-5f68-a727-16eccfbebc32 with identifier: 18569454
2026-03-29 20:23:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d0a5a248-13a7-5f68-a727-16eccfbebc32 with identifier: 18569454
2026-03-29 20:23:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d0a5a248-13a7-5f68-a727-16eccfbebc32 with identifier: 18569454 to the API
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_driver-1774633667392.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd0a5a248-13a7-5f68-a727-16eccfbebc32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL66 GOU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18569454',
'listing': 'auction',
'location': 'Staffordshire Newcastle',
'make': 'Fiat',
'model': '500X',
'odometer': 13461,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1524970,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_driver-1774633667392.jpg',
'Width': 3335},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1874474,
'Height': 2819,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_driver-1774633692502.jpg',
'Width': 3758},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1925020,
'Height': 2788,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_front_passenger-1774633736389.jpg',
'Width': 3717},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1883059,
'Height': 2981,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/18569454/exterior_rear_passenger-1774633711688.jpg',
'Width': 3974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3249361,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/18569454/interior_front_seats-1774634032956.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657275,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/18569454/interior_rear_seats-1774634043324.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1725317,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/18569454/interior_dashboard-1774634081202.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2845620,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/18569454/interior_boot-1774634209020.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632331,
'Height': 3238,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9454/18569454/docs_service_history-1774634372854.jpg?ixlib=js-3.8.0&auto=format&s=b6f4892573ae3e4c6475256a93de2d7e',
'Width': 2251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a5a248-13a7-5f68-a727-16eccfbebc32/d0a5a248-13a7-5f68-a727-16eccfbebc32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1470767,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/18569454/damage_scratches-1774633791408.jpg',
'Width': 4032}],
'price': 5607,
'price_includes_vat': False,
'registration_date': '2016-11-24',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500X POP',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA3340000P529165',
'year': 2016}
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718569454%27 HTTP/1.1" 200 None
2026-03-29 20:23:51 [motorway.uk] INFO: Saving data for 18569454: {'created_time': 1774815831.574373, 'last_price_update_time': 1774815831.574388, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18569454') HTTP/1.1" 204 0
2026-03-29 20:23:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6590662.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbcf77f3-8e61-5b37-b648-0c7e418890f4 with identifier: 6590662
2026-03-29 20:23:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcf77f3-8e61-5b37-b648-0c7e418890f4 with scrape type 1
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_front_driver-1768573586183.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_driver-1768573586183.jpeg not downloaded yet
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_rear_driver-1768573623710.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_driver-1768573623710.jpeg not downloaded yet
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_front_passenger-1768573597098.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_passenger-1768573597098.jpeg not downloaded yet
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_rear_passenger-1768573615281.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_passenger-1768573615281.jpeg not downloaded yet
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_front_seats-1768573728107.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_front_seats-1768573728107.jpeg not downloaded yet
2026-03-29 20:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_rear_seats-1768573862584.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_rear_seats-1768573862584.jpeg not downloaded yet
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_dashboard-1768573890306.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_dashboard-1768573890306.jpeg not downloaded yet
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finstrument_cluster-1768573806501.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/instrument_cluster-1768573806501.jpeg not downloaded yet
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_boot-1768573665658.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_boot-1768573665658.jpeg not downloaded yet
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0662%252F6590662%252F6590662-docs_service_history-modified-1768845873902.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6aad7c77bf49cea2c512d9011140d6b4%27 HTTP/1.1" 200 None
2026-03-29 20:23:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0662/6590662/6590662-docs_service_history-modified-1768845873902.jpeg?ixlib=js-3.8.0&auto=format&s=6aad7c77bf49cea2c512d9011140d6b4 not downloaded yet
2026-03-29 20:23:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20047376.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c2744e-9827-57a8-a2e0-01a7e9a6067c with identifier: 20047376
2026-03-29 20:23:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c with scrape type 1
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_front_driver-1774700094031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_driver-1774700094031.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_rear_driver-1774700117414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_driver-1774700117414.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_front_passenger-1774701642523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_passenger-1774701642523.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_rear_passenger-1774700126499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_passenger-1774700126499.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7376%252F20047376%252Finterior_front_seats-1774700713117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7376/20047376/interior_front_seats-1774700713117.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7376%252F20047376%252Finterior_rear_seats-1774700739550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7376/20047376/interior_rear_seats-1774700739550.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7376%252F20047376%252Finterior_dashboard-1774702212611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7376/20047376/interior_dashboard-1774702212611.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Finstrument_cluster-1774700814234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/instrument_cluster-1774700814234.jpg not downloaded yet
2026-03-29 20:23:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0662/6590662/6590662-docs_service_history-modified-1768845873902.jpeg?ixlib=js-3.8.0&auto=format&s=6aad7c77bf49cea2c512d9011140d6b4> (referer: None)
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7376%252F20047376%252Finterior_boot-1774700775297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7376/20047376/interior_boot-1774700775297.jpg not downloaded yet
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7376%252F20047376%252Fdocs_service_history-1774701124947.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D57676ed86179a519b63f25857c2ec67f%27 HTTP/1.1" 200 None
2026-03-29 20:23:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7376/20047376/docs_service_history-1774701124947.jpg?ixlib=js-3.8.0&auto=format&s=57676ed86179a519b63f25857c2ec67f not downloaded yet
2026-03-29 20:23:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11b3d0>
2026-03-29 20:23:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0662%252F6590662%252F6590662-docs_service_history-modified-1768845873902.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6aad7c77bf49cea2c512d9011140d6b4') HTTP/1.1" 204 0
2026-03-29 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0662/6590662/6590662-docs_service_history-modified-1768845873902.jpeg?ixlib=js-3.8.0&auto=format&s=6aad7c77bf49cea2c512d9011140d6b4 saved to cache
2026-03-29 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:23:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7376/20047376/instrument_cluster-1774700814234.jpg> (referer: None)
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d1e10>
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Finstrument_cluster-1774700814234.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/instrument_cluster-1774700814234.jpg saved to cache
2026-03-29 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7376/20047376/docs_service_history-1774701124947.jpg?ixlib=js-3.8.0&auto=format&s=57676ed86179a519b63f25857c2ec67f> (referer: None)
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca5ef10>
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7376%252F20047376%252Fdocs_service_history-1774701124947.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D57676ed86179a519b63f25857c2ec67f') HTTP/1.1" 204 0
2026-03-29 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7376/20047376/docs_service_history-1774701124947.jpg?ixlib=js-3.8.0&auto=format&s=57676ed86179a519b63f25857c2ec67f saved to cache
2026-03-29 20:23:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7376/20047376/interior_boot-1774700775297.jpg> (referer: None)
2026-03-29 20:23:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d2910>
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7376%252F20047376%252Finterior_boot-1774700775297.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7376/20047376/interior_boot-1774700775297.jpg saved to cache
2026-03-29 20:23:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7376/20047376/interior_dashboard-1774702212611.jpg> (referer: None)
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d041310>
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7376%252F20047376%252Finterior_dashboard-1774702212611.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7376/20047376/interior_dashboard-1774702212611.jpg saved to cache
2026-03-29 20:23:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7376/20047376/interior_rear_seats-1774700739550.jpg> (referer: None)
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c231490>
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7376%252F20047376%252Finterior_rear_seats-1774700739550.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7376/20047376/interior_rear_seats-1774700739550.jpg saved to cache
2026-03-29 20:23:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7376/20047376/interior_front_seats-1774700713117.jpg> (referer: None)
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d043090>
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7376%252F20047376%252Finterior_front_seats-1774700713117.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7376/20047376/interior_front_seats-1774700713117.jpg saved to cache
2026-03-29 20:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_passenger-1774700126499.jpg> (referer: None)
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d786b10>
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_rear_passenger-1774700126499.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_passenger-1774700126499.jpg saved to cache
2026-03-29 20:23:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:23:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_passenger-1774701642523.jpg> (referer: None)
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca5df90>
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_front_passenger-1774701642523.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_passenger-1774701642523.jpg saved to cache
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:24:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_driver-1774700117414.jpg> (referer: None)
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d231650>
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_rear_driver-1774700117414.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_driver-1774700117414.jpg saved to cache
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:24:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_driver-1774700094031.jpg> (referer: None)
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d785210>
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7376%252F20047376%252Fexterior_front_driver-1774700094031.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_driver-1774700094031.jpg saved to cache
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c
2026-03-29 20:24:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27c2744e-9827-57a8-a2e0-01a7e9a6067c, skipping ID generation
2026-03-29 20:24:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c with scrape type 1
2026-03-29 20:24:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27c2744e-9827-57a8-a2e0-01a7e9a6067c sending to next pipeline
2026-03-29 20:24:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 27c2744e-9827-57a8-a2e0-01a7e9a6067c, identifier: 20047376
2026-03-29 20:24:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 27c2744e-9827-57a8-a2e0-01a7e9a6067c with identifier: 20047376
2026-03-29 20:24:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 27c2744e-9827-57a8-a2e0-01a7e9a6067c with identifier: 20047376
2026-03-29 20:24:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 27c2744e-9827-57a8-a2e0-01a7e9a6067c with identifier: 20047376 to the API
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_driver-1774700094031.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '27c2744e-9827-57a8-a2e0-01a7e9a6067c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': '11 TPF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20047376',
'listing': 'auction',
'location': 'East Sussex Uckfield',
'make': 'BMW',
'model': '4 Series',
'odometer': 41765,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606847,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_driver-1774700094031.jpg',
'Width': 3359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1843522,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_driver-1774700117414.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1719857,
'Height': 2569,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_front_passenger-1774701642523.jpg',
'Width': 3425},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543360,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7376/20047376/exterior_rear_passenger-1774700126499.jpg',
'Width': 3174},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3863530,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7376/20047376/interior_front_seats-1774700713117.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3572257,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7376/20047376/interior_rear_seats-1774700739550.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2795859,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7376/20047376/interior_dashboard-1774702212611.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3038479,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7376/20047376/instrument_cluster-1774700814234.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2484909,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7376/20047376/interior_boot-1774700775297.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2744e-9827-57a8-a2e0-01a7e9a6067c/27c2744e-9827-57a8-a2e0-01a7e9a6067c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 977800,
'Height': 723,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7376/20047376/docs_service_history-1774701124947.jpg?ixlib=js-3.8.0&auto=format&s=57676ed86179a519b63f25857c2ec67f',
'Width': 2324}],
'price': 12693,
'price_includes_vat': False,
'registration_date': '2016-11-04',
'seats_number': None,
'seller_name': None,
'title': 'BMW 420D M Sport Auto',
'transmission': 'automatic',
'trim': '420D M Sport Auto',
'vin': 'WBA4U320905A01851',
'year': 2016}
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720047376%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [motorway.uk] INFO: Saving data for 20047376: {'created_time': 1774815841.4127, 'last_price_update_time': 1774815841.412712, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20047376') HTTP/1.1" 204 0
2026-03-29 20:24:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/6590662/interior_boot-1768573665658.jpeg> (referer: None)
2026-03-29 20:24:01 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:24:01 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:24:01 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=d\x85\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x9bA\x00=Zu\x00\x00\x00\x00'
2026-03-29 20:24:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d0550>
2026-03-29 20:24:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_boot-1768573665658.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_boot-1768573665658.jpeg saved to cache
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20382953.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5e2ba0-badb-5177-8ba8-33d525cb4108 with identifier: 20382953
2026-03-29 20:24:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108 with scrape type 1
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_front_driver-1774712924457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_driver-1774712924457.jpg not downloaded yet
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_rear_driver-1774713016573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_driver-1774713016573.jpg not downloaded yet
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_front_passenger-1774712981278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_passenger-1774712981278.jpg not downloaded yet
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_rear_passenger-1774712949648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_passenger-1774712949648.jpg not downloaded yet
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2953%252F20382953%252Finterior_front_seats-1774713583382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2953/20382953/interior_front_seats-1774713583382.jpg not downloaded yet
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2953%252F20382953%252Finterior_rear_seats-1774713601981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2953/20382953/interior_rear_seats-1774713601981.jpg not downloaded yet
2026-03-29 20:24:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Finterior_dashboard-1774713637505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/interior_dashboard-1774713637505.jpg not downloaded yet
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Finstrument_cluster-1774713675716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/instrument_cluster-1774713675716.jpg not downloaded yet
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2953%252F20382953%252Finterior_boot-1774713638844.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2953/20382953/interior_boot-1774713638844.jpg not downloaded yet
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2953%252F20382953%252Fdocs_service_history-1774714864430.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df942e271c163951e1cf0371ad7127774%27 HTTP/1.1" 200 None
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2953/20382953/docs_service_history-1774714864430.jpg?ixlib=js-3.8.0&auto=format&s=f942e271c163951e1cf0371ad7127774 not downloaded yet
2026-03-29 20:24:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/6590662/instrument_cluster-1768573806501.jpeg> (referer: None)
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,\x8f\xb1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02,\x97\x00,\x85\xa1\x00\x00\x00\x00'
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb5850>
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finstrument_cluster-1768573806501.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/instrument_cluster-1768573806501.jpeg saved to cache
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2953/20382953/docs_service_history-1774714864430.jpg?ixlib=js-3.8.0&auto=format&s=f942e271c163951e1cf0371ad7127774> (referer: None)
2026-03-29 20:24:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/6590662/interior_dashboard-1768573890306.jpeg> (referer: None)
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b4710>
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2953%252F20382953%252Fdocs_service_history-1774714864430.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df942e271c163951e1cf0371ad7127774') HTTP/1.1" 204 0
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2953/20382953/docs_service_history-1774714864430.jpg?ixlib=js-3.8.0&auto=format&s=f942e271c163951e1cf0371ad7127774 saved to cache
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004\xa7T\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xfe\xd9\x004\x9dD\x00\x00\x00\x00'
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2e950>
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_dashboard-1768573890306.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_dashboard-1768573890306.jpeg saved to cache
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2953/20382953/interior_boot-1774713638844.jpg> (referer: None)
2026-03-29 20:24:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2953/20382953/instrument_cluster-1774713675716.jpg> (referer: None)
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06a510>
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2953%252F20382953%252Finterior_boot-1774713638844.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2953/20382953/interior_boot-1774713638844.jpg saved to cache
2026-03-29 20:24:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb4650>
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Finstrument_cluster-1774713675716.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/instrument_cluster-1774713675716.jpg saved to cache
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2953/20382953/interior_dashboard-1774713637505.jpg> (referer: None)
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb4b10>
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Finterior_dashboard-1774713637505.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/interior_dashboard-1774713637505.jpg saved to cache
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2953/20382953/interior_rear_seats-1774713601981.jpg> (referer: None)
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea46650>
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2953%252F20382953%252Finterior_rear_seats-1774713601981.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2953/20382953/interior_rear_seats-1774713601981.jpg saved to cache
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_passenger-1774712949648.jpg> (referer: None)
2026-03-29 20:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2953/20382953/interior_front_seats-1774713583382.jpg> (referer: None)
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06aad0>
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_rear_passenger-1774712949648.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_passenger-1774712949648.jpg saved to cache
2026-03-29 20:24:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b5ad0>
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2953%252F20382953%252Finterior_front_seats-1774713583382.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2953/20382953/interior_front_seats-1774713583382.jpg saved to cache
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_passenger-1774712981278.jpg> (referer: None)
2026-03-29 20:24:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_driver-1774713016573.jpg> (referer: None)
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb62d0>
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_front_passenger-1774712981278.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_passenger-1774712981278.jpg saved to cache
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5549d0>
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_rear_driver-1774713016573.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_driver-1774713016573.jpg saved to cache
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_driver-1774712924457.jpg> (referer: None)
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b77d0>
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2953%252F20382953%252Fexterior_front_driver-1774712924457.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_driver-1774712924457.jpg saved to cache
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108
2026-03-29 20:24:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b5e2ba0-badb-5177-8ba8-33d525cb4108, skipping ID generation
2026-03-29 20:24:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108 with scrape type 1
2026-03-29 20:24:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b5e2ba0-badb-5177-8ba8-33d525cb4108 sending to next pipeline
2026-03-29 20:24:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2b5e2ba0-badb-5177-8ba8-33d525cb4108, identifier: 20382953
2026-03-29 20:24:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2b5e2ba0-badb-5177-8ba8-33d525cb4108 with identifier: 20382953
2026-03-29 20:24:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2b5e2ba0-badb-5177-8ba8-33d525cb4108 with identifier: 20382953
2026-03-29 20:24:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2b5e2ba0-badb-5177-8ba8-33d525cb4108 with identifier: 20382953 to the API
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_driver-1774712924457.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2b5e2ba0-badb-5177-8ba8-33d525cb4108',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LP19 RTO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20382953',
'listing': 'auction',
'location': 'None None',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 37000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1463573,
'Height': 2544,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_driver-1774712924457.jpg',
'Width': 3392},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261910,
'Height': 2329,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_driver-1774713016573.jpg',
'Width': 3105},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1004585,
'Height': 2126,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_front_passenger-1774712981278.jpg',
'Width': 2835},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1176468,
'Height': 2354,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2953/20382953/exterior_rear_passenger-1774712949648.jpg',
'Width': 3139},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3469726,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2953/20382953/interior_front_seats-1774713583382.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4257117,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2953/20382953/interior_rear_seats-1774713601981.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2106949,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2953/20382953/interior_dashboard-1774713637505.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2095243,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2953/20382953/instrument_cluster-1774713675716.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2844048,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2953/20382953/interior_boot-1774713638844.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b5e2ba0-badb-5177-8ba8-33d525cb4108/2b5e2ba0-badb-5177-8ba8-33d525cb4108_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397650,
'Height': 2048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2953/20382953/docs_service_history-1774714864430.jpg?ixlib=js-3.8.0&auto=format&s=f942e271c163951e1cf0371ad7127774',
'Width': 1446}],
'price': 14001,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 Sport Executive Auto',
'transmission': 'automatic',
'trim': 'A 180 Sport Executive Auto',
'vin': 'WDD1770842N080778',
'year': 2019}
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382953%27 HTTP/1.1" 200 None
2026-03-29 20:24:05 [motorway.uk] INFO: Saving data for 20382953: {'created_time': 1774815845.096883, 'last_price_update_time': 1774815845.096895, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20382953') HTTP/1.1" 204 0
2026-03-29 20:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/6590662/interior_rear_seats-1768573862584.jpeg> (referer: None)
2026-03-29 20:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/6590662/interior_front_seats-1768573728107.jpeg> (referer: None)
2026-03-29 20:24:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:24:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:24:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00@\xb9\xce\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x02O\x00@\xaf\xbe\x00\x00\x00\x00'
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d554210>
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_rear_seats-1768573862584.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_rear_seats-1768573862584.jpeg saved to cache
2026-03-29 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:24:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:24:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=\xc9\x88\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x80\xba\x00=\xbfx\x00\x00\x00\x00'
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced64d0>
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F6590662%252Finterior_front_seats-1768573728107.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/6590662/interior_front_seats-1768573728107.jpeg saved to cache
2026-03-29 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_passenger-1768573615281.jpeg> (referer: None)
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d773e10>
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_rear_passenger-1768573615281.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_passenger-1768573615281.jpeg saved to cache
2026-03-29 20:24:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:05 [scrapy.extensions.logstats] INFO: Crawled 211 pages (at 13 pages/min), scraped 165 items (at 6 items/min)
2026-03-29 20:24:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_passenger-1768573597098.jpeg> (referer: None)
2026-03-29 20:24:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_driver-1768573623710.jpeg> (referer: None)
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d799310>
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_front_passenger-1768573597098.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_passenger-1768573597098.jpeg saved to cache
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31e010>
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_rear_driver-1768573623710.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_driver-1768573623710.jpeg saved to cache
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_driver-1768573586183.jpeg> (referer: None)
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea469d0>
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F6590662%252Fexterior_front_driver-1768573586183.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_driver-1768573586183.jpeg saved to cache
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbcf77f3-8e61-5b37-b648-0c7e418890f4
2026-03-29 20:24:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbcf77f3-8e61-5b37-b648-0c7e418890f4, skipping ID generation
2026-03-29 20:24:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcf77f3-8e61-5b37-b648-0c7e418890f4 with scrape type 1
2026-03-29 20:24:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbcf77f3-8e61-5b37-b648-0c7e418890f4 sending to next pipeline
2026-03-29 20:24:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dbcf77f3-8e61-5b37-b648-0c7e418890f4, identifier: 6590662
2026-03-29 20:24:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dbcf77f3-8e61-5b37-b648-0c7e418890f4 with identifier: 6590662
2026-03-29 20:24:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dbcf77f3-8e61-5b37-b648-0c7e418890f4 with identifier: 6590662
2026-03-29 20:24:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dbcf77f3-8e61-5b37-b648-0c7e418890f4 with identifier: 6590662 to the API
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_driver-1768573586183.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dbcf77f3-8e61-5b37-b648-0c7e418890f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GL66 PPO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6590662',
'listing': 'auction',
'location': 'South Yorkshire Barnsley',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 79000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1019829,
'Height': 2162,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_driver-1768573586183.jpeg',
'Width': 2883},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1113152,
'Height': 2132,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_driver-1768573623710.jpeg',
'Width': 2843},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1340900,
'Height': 2152,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_front_passenger-1768573597098.jpeg',
'Width': 2869},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890554,
'Height': 1865,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0662/6590662/exterior_rear_passenger-1768573615281.jpeg',
'Width': 2487},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4213314,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/6590662/interior_front_seats-1768573728107.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4439069,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/6590662/interior_rear_seats-1768573862584.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3647021,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/6590662/interior_dashboard-1768573890306.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3062856,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/6590662/instrument_cluster-1768573806501.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4194246,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/6590662/interior_boot-1768573665658.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcf77f3-8e61-5b37-b648-0c7e418890f4/dbcf77f3-8e61-5b37-b648-0c7e418890f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419667,
'Height': 1570,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0662/6590662/6590662-docs_service_history-modified-1768845873902.jpeg?ixlib=js-3.8.0&auto=format&s=6aad7c77bf49cea2c512d9011140d6b4',
'Width': 1178}],
'price': 7559,
'price_includes_vat': False,
'registration_date': '2016-11-26',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo GTI',
'transmission': 'manual',
'trim': 'GTI',
'vin': 'WVWZZZ6RZHY108722',
'year': 2016}
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276590662%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [motorway.uk] INFO: Saving data for 6590662: {'created_time': 1774815847.018765, 'last_price_update_time': 1774815847.018774, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6590662') HTTP/1.1" 204 0
2026-03-29 20:24:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18746892.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 960a2c11-8c4f-5b0f-8d44-393d943046a6 with identifier: 18746892
2026-03-29 20:24:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960a2c11-8c4f-5b0f-8d44-393d943046a6 with scrape type 1
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_front_driver-1774779839974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_driver-1774779839974.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_rear_driver-1774779879274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_driver-1774779879274.jpg not downloaded yet
2026-03-29 20:24:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9667311.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_front_passenger-1774779851925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_passenger-1774779851925.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_rear_passenger-1774779868579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_passenger-1774779868579.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-interior_front_seats-modified-1774788637201.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_front_seats-modified-1774788637201.jpeg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6892%252F18746892%252Finterior_rear_seats-1774779939045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6892/18746892/interior_rear_seats-1774779939045.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-interior_dashboard-modified-1774786387366.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_dashboard-modified-1774786387366.jpeg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-instrument_cluster-modified-1774786378001.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-instrument_cluster-modified-1774786378001.jpeg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-interior_boot-modified-1774788062751.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_boot-modified-1774788062751.jpeg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6892%252F18746892%252F18746892-docs_service_history-modified-1774786365201.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D70ce1aa2f253ee41cad97ef139952388%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6892/18746892/18746892-docs_service_history-modified-1774786365201.jpeg?ixlib=js-3.8.0&auto=format&s=70ce1aa2f253ee41cad97ef139952388 not downloaded yet
2026-03-29 20:24:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fbda3e5-48db-5194-8bc9-b0e3128bd971 with identifier: 9667311
2026-03-29 20:24:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971 with scrape type 1
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_front_driver-1774717784148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_driver-1774717784148.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_rear_driver-1774717858934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_driver-1774717858934.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_front_passenger-1774717897401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_passenger-1774717897401.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_rear_passenger-1774717875618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_passenger-1774717875618.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7311%252F9667311%252Finterior_front_seats-1774718312065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7311/9667311/interior_front_seats-1774718312065.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7311%252F9667311%252Finterior_rear_seats-1774718323938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7311/9667311/interior_rear_seats-1774718323938.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Finterior_dashboard-1774718358382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/interior_dashboard-1774718358382.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7311%252F9667311%252Finstrument_cluster-1774773841602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7311/9667311/instrument_cluster-1774773841602.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7311%252F9667311%252Finterior_boot-1774718378505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7311/9667311/interior_boot-1774718378505.jpg not downloaded yet
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7311%252F9667311%252Fdocs_service_history-1774718540852.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3f5fbff8bf78143ef66d84ab7cb0d557%27 HTTP/1.1" 200 None
2026-03-29 20:24:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7311/9667311/docs_service_history-1774718540852.jpg?ixlib=js-3.8.0&auto=format&s=3f5fbff8bf78143ef66d84ab7cb0d557 not downloaded yet
2026-03-29 20:24:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_driver-1774779839974.jpg> (referer: None)
2026-03-29 20:24:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec74d10>
2026-03-29 20:24:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_front_driver-1774779839974.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_driver-1774779839974.jpg saved to cache
2026-03-29 20:24:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7311/9667311/docs_service_history-1774718540852.jpg?ixlib=js-3.8.0&auto=format&s=3f5fbff8bf78143ef66d84ab7cb0d557> (referer: None)
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07ebd0>
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7311%252F9667311%252Fdocs_service_history-1774718540852.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3f5fbff8bf78143ef66d84ab7cb0d557') HTTP/1.1" 204 0
2026-03-29 20:24:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7311/9667311/docs_service_history-1774718540852.jpg?ixlib=js-3.8.0&auto=format&s=3f5fbff8bf78143ef66d84ab7cb0d557 saved to cache
2026-03-29 20:24:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7311/9667311/interior_boot-1774718378505.jpg> (referer: None)
2026-03-29 20:24:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a7f50>
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7311%252F9667311%252Finterior_boot-1774718378505.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7311/9667311/interior_boot-1774718378505.jpg saved to cache
2026-03-29 20:24:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7311/9667311/instrument_cluster-1774773841602.jpg> (referer: None)
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec774d0>
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7311%252F9667311%252Finstrument_cluster-1774773841602.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7311/9667311/instrument_cluster-1774773841602.jpg saved to cache
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7311/9667311/interior_dashboard-1774718358382.jpg> (referer: None)
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a46d0>
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Finterior_dashboard-1774718358382.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/interior_dashboard-1774718358382.jpg saved to cache
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20465616.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b7adf5-0ec4-5bf8-9222-7b5875841c71 with identifier: 20465616
2026-03-29 20:24:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71 with scrape type 1
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_front_driver-1774703270204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_driver-1774703270204.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_rear_driver-1774703411369.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_driver-1774703411369.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_front_passenger-1774703344917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_passenger-1774703344917.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_rear_passenger-1774703472503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_passenger-1774703472503.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5616%252F20465616%252Finterior_front_seats-1774704780603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5616/20465616/interior_front_seats-1774704780603.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5616%252F20465616%252Finterior_rear_seats-1774704818018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5616/20465616/interior_rear_seats-1774704818018.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Finterior_dashboard-1774704726231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/interior_dashboard-1774704726231.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Finstrument_cluster-1774704391341.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/instrument_cluster-1774704391341.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5616%252F20465616%252Finterior_boot-1774704525159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5616/20465616/interior_boot-1774704525159.jpg not downloaded yet
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5616%252F20465616%252Fdocs_service_history-1774708175830.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae389565a3d21527801ada1368466663%27 HTTP/1.1" 200 None
2026-03-29 20:24:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5616/20465616/docs_service_history-1774708175830.jpg?ixlib=js-3.8.0&auto=format&s=ae389565a3d21527801ada1368466663 not downloaded yet
2026-03-29 20:24:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7311/9667311/interior_rear_seats-1774718323938.jpg> (referer: None)
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e092ed0>
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7311%252F9667311%252Finterior_rear_seats-1774718323938.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7311/9667311/interior_rear_seats-1774718323938.jpg saved to cache
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7311/9667311/interior_front_seats-1774718312065.jpg> (referer: None)
2026-03-29 20:24:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5616/20465616/docs_service_history-1774708175830.jpg?ixlib=js-3.8.0&auto=format&s=ae389565a3d21527801ada1368466663> (referer: None)
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce16a50>
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7311%252F9667311%252Finterior_front_seats-1774718312065.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7311/9667311/interior_front_seats-1774718312065.jpg saved to cache
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0c610>
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5616%252F20465616%252Fdocs_service_history-1774708175830.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae389565a3d21527801ada1368466663') HTTP/1.1" 204 0
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5616/20465616/docs_service_history-1774708175830.jpg?ixlib=js-3.8.0&auto=format&s=ae389565a3d21527801ada1368466663 saved to cache
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5616/20465616/interior_boot-1774704525159.jpg> (referer: None)
2026-03-29 20:24:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5616/20465616/instrument_cluster-1774704391341.jpg> (referer: None)
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ede9590>
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5616%252F20465616%252Finterior_boot-1774704525159.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5616/20465616/interior_boot-1774704525159.jpg saved to cache
2026-03-29 20:24:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce159d0>
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Finstrument_cluster-1774704391341.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/instrument_cluster-1774704391341.jpg saved to cache
2026-03-29 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5616/20465616/interior_dashboard-1774704726231.jpg> (referer: None)
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c273d50>
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Finterior_dashboard-1774704726231.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/interior_dashboard-1774704726231.jpg saved to cache
2026-03-29 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5616/20465616/interior_rear_seats-1774704818018.jpg> (referer: None)
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093610>
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5616%252F20465616%252Finterior_rear_seats-1774704818018.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5616/20465616/interior_rear_seats-1774704818018.jpg saved to cache
2026-03-29 20:24:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_passenger-1774703472503.jpg> (referer: None)
2026-03-29 20:24:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5616/20465616/interior_front_seats-1774704780603.jpg> (referer: None)
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbe8d50>
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_rear_passenger-1774703472503.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_passenger-1774703472503.jpg saved to cache
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0c290>
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5616%252F20465616%252Finterior_front_seats-1774704780603.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5616/20465616/interior_front_seats-1774704780603.jpg saved to cache
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_passenger-1774703344917.jpg> (referer: None)
2026-03-29 20:24:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_driver-1774703411369.jpg> (referer: None)
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce14650>
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_front_passenger-1774703344917.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_passenger-1774703344917.jpg saved to cache
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8fa10>
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_rear_driver-1774703411369.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_driver-1774703411369.jpg saved to cache
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_driver-1774703270204.jpg> (referer: None)
2026-03-29 20:24:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_passenger-1774717875618.jpg> (referer: None)
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce14b10>
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5616%252F20465616%252Fexterior_front_driver-1774703270204.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_driver-1774703270204.jpg saved to cache
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71
2026-03-29 20:24:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89b7adf5-0ec4-5bf8-9222-7b5875841c71, skipping ID generation
2026-03-29 20:24:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71 with scrape type 1
2026-03-29 20:24:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89b7adf5-0ec4-5bf8-9222-7b5875841c71 sending to next pipeline
2026-03-29 20:24:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 89b7adf5-0ec4-5bf8-9222-7b5875841c71, identifier: 20465616
2026-03-29 20:24:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 89b7adf5-0ec4-5bf8-9222-7b5875841c71 with identifier: 20465616
2026-03-29 20:24:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 89b7adf5-0ec4-5bf8-9222-7b5875841c71 with identifier: 20465616
2026-03-29 20:24:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 89b7adf5-0ec4-5bf8-9222-7b5875841c71 with identifier: 20465616 to the API
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_driver-1774703270204.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '89b7adf5-0ec4-5bf8-9222-7b5875841c71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MG17 MCG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20465616',
'listing': 'auction',
'location': 'East Dunbartonshire Council Glasgow',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 6645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849168,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_driver-1774703270204.jpg',
'Width': 3247},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1575683,
'Height': 2303,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_driver-1774703411369.jpg',
'Width': 3070},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1198020,
'Height': 2145,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_front_passenger-1774703344917.jpg',
'Width': 2860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505175,
'Height': 2428,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5616/20465616/exterior_rear_passenger-1774703472503.jpg',
'Width': 3237},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2979321,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5616/20465616/interior_front_seats-1774704780603.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3466734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5616/20465616/interior_rear_seats-1774704818018.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3040835,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5616/20465616/interior_dashboard-1774704726231.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2554638,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5616/20465616/instrument_cluster-1774704391341.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2979958,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5616/20465616/interior_boot-1774704525159.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89b7adf5-0ec4-5bf8-9222-7b5875841c71/89b7adf5-0ec4-5bf8-9222-7b5875841c71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701868,
'Height': 2546,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5616/20465616/docs_service_history-1774708175830.jpg?ixlib=js-3.8.0&auto=format&s=ae389565a3d21527801ada1368466663',
'Width': 3650}],
'price': 24700,
'price_includes_vat': False,
'registration_date': '2023-10-20',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson Ultimate T-GDi HEV Auto',
'transmission': 'automatic',
'trim': 'Ultimate T-GDi HEV Auto',
'vin': 'TMAJE811MPJ231601',
'year': 2023}
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465616%27 HTTP/1.1" 200 None
2026-03-29 20:24:13 [motorway.uk] INFO: Saving data for 20465616: {'created_time': 1774815853.408419, 'last_price_update_time': 1774815853.408431, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20465616') HTTP/1.1" 204 0
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01290>
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_rear_passenger-1774717875618.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_passenger-1774717875618.jpg saved to cache
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_driver-1774717858934.jpg> (referer: None)
2026-03-29 20:24:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_passenger-1774717897401.jpg> (referer: None)
2026-03-29 20:24:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_driver-1774717784148.jpg> (referer: None)
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc1430b090>
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_rear_driver-1774717858934.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_driver-1774717858934.jpg saved to cache
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e091310>
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_front_passenger-1774717897401.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_passenger-1774717897401.jpg saved to cache
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6892/18746892/18746892-docs_service_history-modified-1774786365201.jpeg?ixlib=js-3.8.0&auto=format&s=70ce1aa2f253ee41cad97ef139952388> (referer: None)
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c230b90>
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7311%252F9667311%252Fexterior_front_driver-1774717784148.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_driver-1774717784148.jpg saved to cache
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971
2026-03-29 20:24:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fbda3e5-48db-5194-8bc9-b0e3128bd971, skipping ID generation
2026-03-29 20:24:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971 with scrape type 1
2026-03-29 20:24:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fbda3e5-48db-5194-8bc9-b0e3128bd971 sending to next pipeline
2026-03-29 20:24:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3fbda3e5-48db-5194-8bc9-b0e3128bd971, identifier: 9667311
2026-03-29 20:24:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3fbda3e5-48db-5194-8bc9-b0e3128bd971 with identifier: 9667311
2026-03-29 20:24:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3fbda3e5-48db-5194-8bc9-b0e3128bd971 with identifier: 9667311
2026-03-29 20:24:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3fbda3e5-48db-5194-8bc9-b0e3128bd971 with identifier: 9667311 to the API
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_driver-1774717784148.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3fbda3e5-48db-5194-8bc9-b0e3128bd971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SD20 CEA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9667311',
'listing': 'auction',
'location': 'Moray Forres',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 43085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1081079,
'Height': 2162,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_driver-1774717784148.jpg',
'Width': 2883},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1126265,
'Height': 2197,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_driver-1774717858934.jpg',
'Width': 2929},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1414603,
'Height': 2434,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_front_passenger-1774717897401.jpg',
'Width': 3245},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387650,
'Height': 2513,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7311/9667311/exterior_rear_passenger-1774717875618.jpg',
'Width': 3351},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4088678,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7311/9667311/interior_front_seats-1774718312065.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3592280,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7311/9667311/interior_rear_seats-1774718323938.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2150548,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7311/9667311/interior_dashboard-1774718358382.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1409000,
'Height': 2670,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7311/9667311/instrument_cluster-1774773841602.jpg',
'Width': 3560},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3806743,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7311/9667311/interior_boot-1774718378505.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fbda3e5-48db-5194-8bc9-b0e3128bd971/3fbda3e5-48db-5194-8bc9-b0e3128bd971_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249465,
'Height': 2130,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7311/9667311/docs_service_history-1774718540852.jpg?ixlib=js-3.8.0&auto=format&s=3f5fbff8bf78143ef66d84ab7cb0d557',
'Width': 1433}],
'price': 19600,
'price_includes_vat': False,
'registration_date': '2020-06-05',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE Chequered Flag AWD D A',
'transmission': 'automatic',
'trim': 'Chequered Flag AWD D A',
'vin': 'SADCA2ANXLA649341',
'year': 2020}
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279667311%27 HTTP/1.1" 200 None
2026-03-29 20:24:14 [motorway.uk] INFO: Saving data for 9667311: {'created_time': 1774815854.388867, 'last_price_update_time': 1774815854.388879, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9667311') HTTP/1.1" 204 0
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9c710>
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6892%252F18746892%252F18746892-docs_service_history-modified-1774786365201.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D70ce1aa2f253ee41cad97ef139952388') HTTP/1.1" 204 0
2026-03-29 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6892/18746892/18746892-docs_service_history-modified-1774786365201.jpeg?ixlib=js-3.8.0&auto=format&s=70ce1aa2f253ee41cad97ef139952388 saved to cache
2026-03-29 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_boot-modified-1774788062751.jpeg> (referer: None)
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbe8590>
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-interior_boot-modified-1774788062751.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_boot-modified-1774788062751.jpeg saved to cache
2026-03-29 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6892/18746892/18746892-instrument_cluster-modified-1774786378001.jpeg> (referer: None)
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbe8a90>
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-instrument_cluster-modified-1774786378001.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-instrument_cluster-modified-1774786378001.jpeg saved to cache
2026-03-29 20:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6892/18746892/interior_rear_seats-1774779939045.jpg> (referer: None)
2026-03-29 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_dashboard-modified-1774786387366.jpeg> (referer: None)
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d233b10>
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6892%252F18746892%252Finterior_rear_seats-1774779939045.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6892/18746892/interior_rear_seats-1774779939045.jpg saved to cache
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1ab210>
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-interior_dashboard-modified-1774786387366.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_dashboard-modified-1774786387366.jpeg saved to cache
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_front_seats-modified-1774788637201.jpeg> (referer: None)
2026-03-29 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_passenger-1774779868579.jpg> (referer: None)
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d08c310>
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6892%252F18746892%252F18746892-interior_front_seats-modified-1774788637201.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_front_seats-modified-1774788637201.jpeg saved to cache
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c273f90>
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_rear_passenger-1774779868579.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_passenger-1774779868579.jpg saved to cache
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_passenger-1774779851925.jpg> (referer: None)
2026-03-29 20:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_driver-1774779879274.jpg> (referer: None)
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ede8b90>
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_front_passenger-1774779851925.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_passenger-1774779851925.jpg saved to cache
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c231410>
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6892%252F18746892%252Fexterior_rear_driver-1774779879274.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_driver-1774779879274.jpg saved to cache
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 960a2c11-8c4f-5b0f-8d44-393d943046a6
2026-03-29 20:24:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 960a2c11-8c4f-5b0f-8d44-393d943046a6, skipping ID generation
2026-03-29 20:24:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960a2c11-8c4f-5b0f-8d44-393d943046a6 with scrape type 1
2026-03-29 20:24:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 960a2c11-8c4f-5b0f-8d44-393d943046a6 sending to next pipeline
2026-03-29 20:24:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 960a2c11-8c4f-5b0f-8d44-393d943046a6, identifier: 18746892
2026-03-29 20:24:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 960a2c11-8c4f-5b0f-8d44-393d943046a6 with identifier: 18746892
2026-03-29 20:24:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 960a2c11-8c4f-5b0f-8d44-393d943046a6 with identifier: 18746892
2026-03-29 20:24:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 960a2c11-8c4f-5b0f-8d44-393d943046a6 with identifier: 18746892 to the API
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_driver-1774779879274.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '960a2c11-8c4f-5b0f-8d44-393d943046a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FD74 HFJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18746892',
'listing': 'auction',
'location': 'Derbyshire Belper',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 9865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1066523,
'Height': 2018,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_driver-1774779839974.jpg',
'Width': 2690},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 736353,
'Height': 1910,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_driver-1774779879274.jpg',
'Width': 2547},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 845400,
'Height': 1922,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_front_passenger-1774779851925.jpg',
'Width': 2563},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809851,
'Height': 1896,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6892/18746892/exterior_rear_passenger-1774779868579.jpg',
'Width': 2528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1405063,
'Height': 2439,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_front_seats-modified-1774788637201.jpeg',
'Width': 3252},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458746,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6892/18746892/interior_rear_seats-1774779939045.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1273692,
'Height': 2092,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_dashboard-modified-1774786387366.jpeg',
'Width': 2789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147970,
'Height': 1034,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6892/18746892/18746892-instrument_cluster-modified-1774786378001.jpeg',
'Width': 1379},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1320034,
'Height': 2236,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6892/18746892/18746892-interior_boot-modified-1774788062751.jpeg',
'Width': 2981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960a2c11-8c4f-5b0f-8d44-393d943046a6/960a2c11-8c4f-5b0f-8d44-393d943046a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80420,
'Height': 1035,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6892/18746892/18746892-docs_service_history-modified-1774786365201.jpeg?ixlib=js-3.8.0&auto=format&s=70ce1aa2f253ee41cad97ef139952388',
'Width': 776}],
'price': 24900,
'price_includes_vat': False,
'registration_date': '2024-12-12',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Corolla GR Sport HEV CVT',
'transmission': 'automatic',
'trim': 'GR Sport HEV CVT',
'vin': 'SB1ZC3CE50E037754',
'year': 2024}
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718746892%27 HTTP/1.1" 200 None
2026-03-29 20:24:16 [motorway.uk] INFO: Saving data for 18746892: {'created_time': 1774815856.507641, 'last_price_update_time': 1774815856.507652, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18746892') HTTP/1.1" 204 0
2026-03-29 20:24:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19815321.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf02d2fc-1edc-5732-945c-caf7ff13f1ef with identifier: 19815321
2026-03-29 20:24:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef with scrape type 1
2026-03-29 20:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_front_driver-1773577258189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_driver-1773577258189.jpg not downloaded yet
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_rear_driver-1773577263984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_driver-1773577263984.jpg not downloaded yet
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_front_passenger-1774699116238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_passenger-1774699116238.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_rear_passenger-1774699031209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_passenger-1774699031209.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finterior_front_seats-1774784178648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/interior_front_seats-1774784178648.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finterior_dashboard-1774784217147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/interior_dashboard-1774784217147.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finstrument_cluster-1774782548488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/instrument_cluster-1774782548488.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finterior_boot-1774782541764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/interior_boot-1774782541764.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5321%252F19815321%252Fdamage_scratches-1773575811267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5321/19815321/damage_scratches-1773575811267.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Fdamage_missing_trims-1774782520217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/damage_missing_trims-1774782520217.jpg not downloaded yet
2026-03-29 20:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20471256/exterior_rear_passenger-1774693908956.jpg> (referer: None)
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed9a690>
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20471256%252Fexterior_rear_passenger-1774693908956.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20471256/exterior_rear_passenger-1774693908956.jpg saved to cache
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5321/19815321/damage_missing_trims-1774782520217.jpg> (referer: None)
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0333d0>
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Fdamage_missing_trims-1774782520217.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/damage_missing_trims-1774782520217.jpg saved to cache
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19601308.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5321/19815321/damage_scratches-1773575811267.jpg> (referer: None)
2026-03-29 20:24:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6e129e7-8911-504d-8901-28afd2cd45a7 with identifier: 19601308
2026-03-29 20:24:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6e129e7-8911-504d-8901-28afd2cd45a7 with scrape type 1
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_front_driver-1774628409202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_driver-1774628409202.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_rear_driver-1774628427182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_driver-1774628427182.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_front_passenger-1774628451607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_passenger-1774628451607.jpg not downloaded yet
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_rear_passenger-1774628436598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_passenger-1774628436598.jpg not downloaded yet
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A217F\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A217FXXSCDXE2\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xb8\x0b\x00\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:17 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:15 11:55:57\x00'
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d32b190>
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5321%252F19815321%252Fdamage_scratches-1773575811267.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5321/19815321/damage_scratches-1773575811267.jpg saved to cache
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1308%252F19601308%252Finterior_front_seats-1774628755441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1308/19601308/interior_front_seats-1774628755441.jpg not downloaded yet
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1308%252F19601308%252Finterior_rear_seats-1774628944765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1308/19601308/interior_rear_seats-1774628944765.jpg not downloaded yet
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Finterior_dashboard-1774628805717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/interior_dashboard-1774628805717.jpg not downloaded yet
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Finstrument_cluster-1774628845652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/instrument_cluster-1774628845652.jpg not downloaded yet
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1308%252F19601308%252Finterior_boot-1774628815170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1308/19601308/interior_boot-1774628815170.jpg not downloaded yet
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1308%252F19601308%252Fdocs_service_history-1774690969685.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04fa25fc9ac73e0b18475b269b6dee0d%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1308/19601308/docs_service_history-1774690969685.jpg?ixlib=js-3.8.0&auto=format&s=04fa25fc9ac73e0b18475b269b6dee0d not downloaded yet
2026-03-29 20:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5321/19815321/interior_boot-1774782541764.jpg> (referer: None)
2026-03-29 20:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1308/19601308/interior_front_seats-1774628755441.jpg> (referer: None)
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc1539f410>
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finterior_boot-1774782541764.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/interior_boot-1774782541764.jpg saved to cache
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce16b10>
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1308%252F19601308%252Finterior_front_seats-1774628755441.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1308/19601308/interior_front_seats-1774628755441.jpg saved to cache
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=828&page=23&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1308/19601308/interior_boot-1774628815170.jpg> (referer: None)
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20345939
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 12444904
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712444904%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 12444904: 1
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20479213
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 5678750
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275678750%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 5678750: 1
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 1379253
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271379253%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 1379253: 1
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20147268
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20465867
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 18276171
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20490982
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20494330
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20486417
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 19705843
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 6409208
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20049212
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 12893788
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20129049
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720129049%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 20129049: 1
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 19812836
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719812836%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 19812836: 1
2026-03-29 20:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1308/19601308/docs_service_history-1774690969685.jpg?ixlib=js-3.8.0&auto=format&s=04fa25fc9ac73e0b18475b269b6dee0d> (referer: None)
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 7025214
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20458640
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 12548446
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20453033
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20028099
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720028099%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 20028099: 1
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6e250>
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1308%252F19601308%252Finterior_boot-1774628815170.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1308/19601308/interior_boot-1774628815170.jpg saved to cache
2026-03-29 20:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20414917
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 18114859
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718114859%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 18114859: 1
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20498769
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20401260
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401260%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 20401260: 1
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20421513
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 19128404
2026-03-29 20:24:18 [motorway.uk] INFO: Found listing with ID: 20306533
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720306533%27 HTTP/1.1" 200 None
2026-03-29 20:24:18 [motorway.uk] INFO: Scrape type for 20306533: 1
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce11910>
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1308%252F19601308%252Fdocs_service_history-1774690969685.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04fa25fc9ac73e0b18475b269b6dee0d') HTTP/1.1" 204 0
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1308/19601308/docs_service_history-1774690969685.jpg?ixlib=js-3.8.0&auto=format&s=04fa25fc9ac73e0b18475b269b6dee0d saved to cache
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 20304701
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 20378364
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720378364%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [motorway.uk] INFO: Scrape type for 20378364: 1
2026-03-29 20:24:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15294916.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 18272017
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 20445540
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 20500409
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 18253303
2026-03-29 20:24:19 [motorway.uk] INFO: Found listing with ID: 18656000
2026-03-29 20:24:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 294d45e1-6b09-5941-a5a3-fa5b4d22625b with identifier: 15294916
2026-03-29 20:24:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b with scrape type 1
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F15294916%252Fexterior_front_driver-1774544666805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_driver-1774544666805.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F15294916%252Fexterior_rear_driver-1774544683505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_rear_driver-1774544683505.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F15294916%252Fexterior_front_passenger-1774544708212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_passenger-1774544708212.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F15294916%252Fexterior_rear_passenger-1774694190508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/15294916/exterior_rear_passenger-1774694190508.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Finterior_front_seats-1774545164301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/interior_front_seats-1774545164301.jpg not downloaded yet
2026-03-29 20:24:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1308/19601308/interior_dashboard-1774628805717.jpg> (referer: None)
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Finterior_rear_seats-1774545201801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/interior_rear_seats-1774545201801.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F15294916%252Finterior_dashboard-1774620872085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/15294916/interior_dashboard-1774620872085.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Finterior_boot-1774545142069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/interior_boot-1774545142069.jpg not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4916%252F15294916%252Fdocs_service_history-1774694218459.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47ff068d1de56378690b2449ad532ccf%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4916/15294916/docs_service_history-1774694218459.jpg?ixlib=js-3.8.0&auto=format&s=47ff068d1de56378690b2449ad532ccf not downloaded yet
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Fdamage_scratches-1774544756429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/damage_scratches-1774544756429.jpg not downloaded yet
2026-03-29 20:24:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1308/19601308/instrument_cluster-1774628845652.jpg> (referer: None)
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c271310>
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Finterior_dashboard-1774628805717.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/interior_dashboard-1774628805717.jpg saved to cache
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1d6a50>
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Finstrument_cluster-1774628845652.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/instrument_cluster-1774628845652.jpg saved to cache
2026-03-29 20:24:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4916/15294916/exterior_rear_passenger-1774694190508.jpg> (referer: None)
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d041550>
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F15294916%252Fexterior_rear_passenger-1774694190508.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/15294916/exterior_rear_passenger-1774694190508.jpg saved to cache
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4916/15294916/docs_service_history-1774694218459.jpg?ixlib=js-3.8.0&auto=format&s=47ff068d1de56378690b2449ad532ccf> (referer: None)
2026-03-29 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4916/15294916/damage_scratches-1774544756429.jpg> (referer: None)
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01310>
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4916%252F15294916%252Fdocs_service_history-1774694218459.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47ff068d1de56378690b2449ad532ccf') HTTP/1.1" 204 0
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4916/15294916/docs_service_history-1774694218459.jpg?ixlib=js-3.8.0&auto=format&s=47ff068d1de56378690b2449ad532ccf saved to cache
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d040ed0>
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Fdamage_scratches-1774544756429.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/damage_scratches-1774544756429.jpg saved to cache
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8915220.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4916/15294916/interior_dashboard-1774620872085.jpg> (referer: None)
2026-03-29 20:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4916/15294916/interior_boot-1774545142069.jpg> (referer: None)
2026-03-29 20:24:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9799f6a-77fd-59c8-af65-af60f2850cf5 with identifier: 8915220
2026-03-29 20:24:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9799f6a-77fd-59c8-af65-af60f2850cf5 with scrape type 1
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5220%252F8915220%252F8915220-exterior_front_driver-modified-1774701111062.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5220/8915220/8915220-exterior_front_driver-modified-1774701111062.jpeg not downloaded yet
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Fexterior_rear_driver-1774699273598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_driver-1774699273598.jpg not downloaded yet
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Fexterior_front_passenger-1774699253633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_front_passenger-1774699253633.jpg not downloaded yet
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2109d0>
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4916%252F15294916%252Finterior_dashboard-1774620872085.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4916/15294916/interior_dashboard-1774620872085.jpg saved to cache
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Fexterior_rear_passenger-1774699133892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_passenger-1774699133892.jpg not downloaded yet
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf32f10>
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Finterior_boot-1774545142069.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/interior_boot-1774545142069.jpg saved to cache
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Finterior_front_seats-1774699299705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/interior_front_seats-1774699299705.jpg not downloaded yet
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Finterior_rear_seats-1774699393119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/interior_rear_seats-1774699393119.jpg not downloaded yet
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Finterior_dashboard-1774699433593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/interior_dashboard-1774699433593.jpg not downloaded yet
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Finterior_boot-1774699465912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/interior_boot-1774699465912.jpg not downloaded yet
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Fdamage_scratches-1774699836067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699836067.jpg not downloaded yet
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Fdamage_scratches-1774699896851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699896851.jpg not downloaded yet
2026-03-29 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4916/15294916/interior_rear_seats-1774545201801.jpg> (referer: None)
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec28a90>
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Finterior_rear_seats-1774545201801.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/interior_rear_seats-1774545201801.jpg saved to cache
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4916/15294916/interior_front_seats-1774545164301.jpg> (referer: None)
2026-03-29 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699896851.jpg> (referer: None)
2026-03-29 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5220/8915220/interior_boot-1774699465912.jpg> (referer: None)
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec297d0>
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4916%252F15294916%252Finterior_front_seats-1774545164301.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4916/15294916/interior_front_seats-1774545164301.jpg saved to cache
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16eb10>
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Fdamage_scratches-1774699896851.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699896851.jpg saved to cache
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c2bd0>
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Finterior_boot-1774699465912.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/interior_boot-1774699465912.jpg saved to cache
2026-03-29 20:24:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.506(s), this was the 1st time calling it.
2026-03-29 20:24:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.266645254208721 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_front_passenger-1774699253633.jpg> (referer: None)
2026-03-29 20:24:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699836067.jpg> (referer: None)
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ee550>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Fexterior_front_passenger-1774699253633.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_front_passenger-1774699253633.jpg saved to cache
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d785ad0>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Fdamage_scratches-1774699836067.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699836067.jpg saved to cache
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5220/8915220/interior_front_seats-1774699299705.jpg> (referer: None)
2026-03-29 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5220/8915220/interior_rear_seats-1774699393119.jpg> (referer: None)
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e072090>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Finterior_front_seats-1774699299705.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/interior_front_seats-1774699299705.jpg saved to cache
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d3090>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5220%252F8915220%252Finterior_rear_seats-1774699393119.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5220/8915220/interior_rear_seats-1774699393119.jpg saved to cache
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5220/8915220/interior_dashboard-1774699433593.jpg> (referer: None)
2026-03-29 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471522.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_driver-1774699273598.jpg> (referer: None)
2026-03-29 20:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_passenger-1774699133892.jpg> (referer: None)
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0706d0>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Finterior_dashboard-1774699433593.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/interior_dashboard-1774699433593.jpg saved to cache
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bebf1244-c9fc-5d4e-aa60-74871fe312eb with identifier: 20471522
2026-03-29 20:24:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebf1244-c9fc-5d4e-aa60-74871fe312eb with scrape type 1
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Fexterior_front_driver-1774616191161.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_front_driver-1774616191161.jpg not downloaded yet
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec17d50>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Fexterior_rear_driver-1774699273598.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_driver-1774699273598.jpg saved to cache
2026-03-29 20:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d145d50>
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5220%252F8915220%252Fexterior_rear_passenger-1774699133892.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_passenger-1774699133892.jpg saved to cache
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Fexterior_rear_driver-1774616211158.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_rear_driver-1774616211158.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Fexterior_front_passenger-1774616249414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_front_passenger-1774616249414.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Fexterior_rear_passenger-1774616232795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_rear_passenger-1774616232795.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Finterior_front_seats-1774616596975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/interior_front_seats-1774616596975.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Finterior_rear_seats-1774616614962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/interior_rear_seats-1774616614962.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Finterior_dashboard-1774616655733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/interior_dashboard-1774616655733.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Finstrument_cluster-1774616798917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/instrument_cluster-1774616798917.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Finterior_boot-1774618037729.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/interior_boot-1774618037729.jpg not downloaded yet
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Fdamage_warning_lights-1774618229433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/damage_warning_lights-1774618229433.jpg not downloaded yet
2026-03-29 20:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_rear_driver-1774544683505.jpg> (referer: None)
2026-03-29 20:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5220/8915220/8915220-exterior_front_driver-modified-1774701111062.jpeg> (referer: None)
2026-03-29 20:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_passenger-1774544708212.jpg> (referer: None)
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca26f10>
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F15294916%252Fexterior_rear_driver-1774544683505.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_rear_driver-1774544683505.jpg saved to cache
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20476962.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce69050>
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5220%252F8915220%252F8915220-exterior_front_driver-modified-1774701111062.jpeg') HTTP/1.1" 204 0
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5220/8915220/8915220-exterior_front_driver-modified-1774701111062.jpeg saved to cache
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9799f6a-77fd-59c8-af65-af60f2850cf5
2026-03-29 20:24:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9799f6a-77fd-59c8-af65-af60f2850cf5, skipping ID generation
2026-03-29 20:24:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9799f6a-77fd-59c8-af65-af60f2850cf5 with scrape type 1
2026-03-29 20:24:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9799f6a-77fd-59c8-af65-af60f2850cf5 sending to next pipeline
2026-03-29 20:24:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b9799f6a-77fd-59c8-af65-af60f2850cf5, identifier: 8915220
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01fa90>
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F15294916%252Fexterior_front_passenger-1774544708212.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_passenger-1774544708212.jpg saved to cache
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b9799f6a-77fd-59c8-af65-af60f2850cf5 with identifier: 8915220
2026-03-29 20:24:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b9799f6a-77fd-59c8-af65-af60f2850cf5 with identifier: 8915220
2026-03-29 20:24:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b9799f6a-77fd-59c8-af65-af60f2850cf5 with identifier: 8915220 to the API
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5220/8915220/8915220-exterior_front_driver-modified-1774701111062.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b9799f6a-77fd-59c8-af65-af60f2850cf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MC19 FFA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8915220',
'listing': 'auction',
'location': 'Greater Manchester Leigh',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 48117,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484036,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5220/8915220/8915220-exterior_front_driver-modified-1774701111062.jpeg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1333970,
'Height': 2966,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_driver-1774699273598.jpg',
'Width': 3955},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1567140,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_front_passenger-1774699253633.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1416125,
'Height': 2785,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5220/8915220/exterior_rear_passenger-1774699133892.jpg',
'Width': 3713},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1961265,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/5220/8915220/interior_front_seats-1774699299705.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1682247,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/5220/8915220/interior_rear_seats-1774699393119.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1854822,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5220/8915220/interior_dashboard-1774699433593.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548200,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/5220/8915220/interior_boot-1774699465912.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1569065,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699836067.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9799f6a-77fd-59c8-af65-af60f2850cf5/b9799f6a-77fd-59c8-af65-af60f2850cf5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1369937,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/5220/8915220/damage_scratches-1774699896851.jpg',
'Width': 4000}],
'price': 3479,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Sandero Essential SCE',
'transmission': 'manual',
'trim': 'Essential SCE',
'vin': 'UU1B5220763405247',
'year': 2019}
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278915220%27 HTTP/1.1" 200 None
2026-03-29 20:24:24 [motorway.uk] INFO: Saving data for 8915220: {'created_time': 1774815864.640182, 'last_price_update_time': 1774815864.640195, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8915220') HTTP/1.1" 204 0
2026-03-29 20:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_driver-1774544666805.jpg> (referer: None)
2026-03-29 20:24:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efbb061a-d82d-527d-910c-87ae802e8035 with identifier: 20476962
2026-03-29 20:24:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efbb061a-d82d-527d-910c-87ae802e8035 with scrape type 1
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fexterior_front_driver-1774633703301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_driver-1774633703301.jpg not downloaded yet
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fexterior_rear_driver-1774633714568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_rear_driver-1774633714568.jpg not downloaded yet
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fexterior_front_passenger-1774633739097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_passenger-1774633739097.jpg not downloaded yet
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fexterior_rear_passenger-1774633727414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_rear_passenger-1774633727414.jpg not downloaded yet
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6962%252F20476962%252Finterior_front_seats-1774634049064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6962/20476962/interior_front_seats-1774634049064.jpg not downloaded yet
2026-03-29 20:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07f410>
2026-03-29 20:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4916%252F15294916%252Fexterior_front_driver-1774544666805.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_driver-1774544666805.jpg saved to cache
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b
2026-03-29 20:24:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 294d45e1-6b09-5941-a5a3-fa5b4d22625b, skipping ID generation
2026-03-29 20:24:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b with scrape type 1
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 294d45e1-6b09-5941-a5a3-fa5b4d22625b sending to next pipeline
2026-03-29 20:24:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 294d45e1-6b09-5941-a5a3-fa5b4d22625b, identifier: 15294916
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Finterior_dashboard-1774634153402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/interior_dashboard-1774634153402.jpg not downloaded yet
2026-03-29 20:24:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 294d45e1-6b09-5941-a5a3-fa5b4d22625b with identifier: 15294916
2026-03-29 20:24:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 294d45e1-6b09-5941-a5a3-fa5b4d22625b with identifier: 15294916
2026-03-29 20:24:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 294d45e1-6b09-5941-a5a3-fa5b4d22625b with identifier: 15294916 to the API
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_driver-1774544666805.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '294d45e1-6b09-5941-a5a3-fa5b4d22625b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA66 XDY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15294916',
'listing': 'auction',
'location': 'Greater London Croydon',
'make': 'DS',
'model': 'DS5',
'odometer': 132000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1654124,
'Height': 2807,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_driver-1774544666805.jpg',
'Width': 3743},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1590591,
'Height': 2623,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_rear_driver-1774544683505.jpg',
'Width': 3497},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007042,
'Height': 2787,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4916/15294916/exterior_front_passenger-1774544708212.jpg',
'Width': 3716},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2337201,
'Height': 2705,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4916/15294916/exterior_rear_passenger-1774694190508.jpg',
'Width': 3607},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3267665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4916/15294916/interior_front_seats-1774545164301.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3370919,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4916/15294916/interior_rear_seats-1774545201801.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2433999,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4916/15294916/interior_dashboard-1774620872085.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646021,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4916/15294916/interior_boot-1774545142069.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2344735,
'Height': 6048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4916/15294916/docs_service_history-1774694218459.jpg?ixlib=js-3.8.0&auto=format&s=47ff068d1de56378690b2449ad532ccf',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d45e1-6b09-5941-a5a3-fa5b4d22625b/294d45e1-6b09-5941-a5a3-fa5b4d22625b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2607527,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4916/15294916/damage_scratches-1774544756429.jpg',
'Width': 4032}],
'price': 2542,
'price_includes_vat': False,
'registration_date': '2017-01-23',
'seats_number': None,
'seller_name': None,
'title': 'DS DS5 Prestige BlueHDi S/S Auto',
'transmission': 'automatic',
'trim': 'Prestige BlueHDi S/S Auto',
'vin': 'VF7KFAHWTGS509796',
'year': 2017}
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715294916%27 HTTP/1.1" 200 None
2026-03-29 20:24:25 [motorway.uk] INFO: Saving data for 15294916: {'created_time': 1774815865.521494, 'last_price_update_time': 1774815865.521506, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15294916') HTTP/1.1" 204 0
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Finstrument_cluster-1774634165403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/instrument_cluster-1774634165403.jpg not downloaded yet
2026-03-29 20:24:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6962%252F20476962%252Finterior_boot-1774634130939.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6962/20476962/interior_boot-1774634130939.jpg not downloaded yet
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fwheels_front_driver-1774633817056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_front_driver-1774633817056.jpg not downloaded yet
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fwheels_rear_driver-1774633837373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_rear_driver-1774633837373.jpg not downloaded yet
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1522/20471522/damage_warning_lights-1774618229433.jpg> (referer: None)
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1522/20471522/instrument_cluster-1774616798917.jpg> (referer: None)
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1522/20471522/interior_dashboard-1774616655733.jpg> (referer: None)
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1522/20471522/interior_boot-1774618037729.jpg> (referer: None)
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1522/20471522/interior_rear_seats-1774616614962.jpg> (referer: None)
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20423398.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f02210>
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Fdamage_warning_lights-1774618229433.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/damage_warning_lights-1774618229433.jpg saved to cache
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20464480.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07f3d0>
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Finstrument_cluster-1774616798917.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/instrument_cluster-1774616798917.jpg saved to cache
2026-03-29 20:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d011910>
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Finterior_dashboard-1774616655733.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/interior_dashboard-1774616655733.jpg saved to cache
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13b310>
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Finterior_boot-1774618037729.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/interior_boot-1774618037729.jpg saved to cache
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d013290>
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Finterior_rear_seats-1774616614962.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/interior_rear_seats-1774616614962.jpg saved to cache
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a494661-9ac6-5ce6-8a79-2802aef5d1bc with identifier: 20423398
2026-03-29 20:24:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc with scrape type 1
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_front_driver-1774458908596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_driver-1774458908596.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_rear_driver-1774458972605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_rear_driver-1774458972605.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_front_passenger-1774458906107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_passenger-1774458906107.jpg not downloaded yet
2026-03-29 20:24:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b175253e-5a53-568a-8e1c-8eb9b9c116cc with identifier: 20464480
2026-03-29 20:24:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b175253e-5a53-568a-8e1c-8eb9b9c116cc with scrape type 1
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_front_driver-1774690933768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_driver-1774690933768.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_rear_passenger-1774458901897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_rear_passenger-1774458901897.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_rear_driver-1774691089585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_driver-1774691089585.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3398%252F20423398%252Finterior_front_seats-1774625401182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3398/20423398/interior_front_seats-1774625401182.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_front_passenger-1774690988182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_passenger-1774690988182.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3398%252F20423398%252Finterior_rear_seats-1774622253138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3398/20423398/interior_rear_seats-1774622253138.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_rear_passenger-1774690968903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_passenger-1774690968903.jpg not downloaded yet
2026-03-29 20:24:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_rear_driver-1774633837373.jpg> (referer: None)
2026-03-29 20:24:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_driver-1774458908596.jpg> (referer: None)
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3398%252F20423398%252Finterior_dashboard-1774626287341.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3398/20423398/interior_dashboard-1774626287341.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finterior_front_seats-1774774421765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/interior_front_seats-1774774421765.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Finstrument_cluster-1774460035986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/instrument_cluster-1774460035986.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finterior_rear_seats-1774774428603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/interior_rear_seats-1774774428603.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3398%252F20423398%252Finterior_boot-1774622083244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3398/20423398/interior_boot-1774622083244.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Finterior_dashboard-1774691516382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/interior_dashboard-1774691516382.jpg not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3398%252F20423398%252Fdocs_service_history-1774625853099.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba4d9bec636a92740554921f119d24c9%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3398/20423398/docs_service_history-1774625853099.jpg?ixlib=js-3.8.0&auto=format&s=ba4d9bec636a92740554921f119d24c9 not downloaded yet
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finstrument_cluster-1774774282068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/instrument_cluster-1774774282068.jpg not downloaded yet
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9962d0>
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fwheels_rear_driver-1774633837373.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_rear_driver-1774633837373.jpg saved to cache
2026-03-29 20:24:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9db710>
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_front_driver-1774458908596.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_driver-1774458908596.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finterior_boot-1774693041230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/interior_boot-1774693041230.jpg not downloaded yet
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4480%252F20464480%252Fdocs_service_history-1774774479753.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ab7009a4dc09eb2add9133a762fb24a%27 HTTP/1.1" 200 None
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4480/20464480/docs_service_history-1774774479753.jpg?ixlib=js-3.8.0&auto=format&s=6ab7009a4dc09eb2add9133a762fb24a not downloaded yet
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_front_driver-1774633817056.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6962/20476962/instrument_cluster-1774634165403.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3398/20423398/interior_rear_seats-1774622253138.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6962/20476962/interior_front_seats-1774634049064.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6962/20476962/interior_boot-1774634130939.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_passenger-1774690968903.jpg> (referer: None)
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31ea90>
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fwheels_front_driver-1774633817056.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_front_driver-1774633817056.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31ebd0>
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Finstrument_cluster-1774634165403.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/instrument_cluster-1774634165403.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 14:37:26\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\x07\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca49910>
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3398%252F20423398%252Finterior_rear_seats-1774622253138.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3398/20423398/interior_rear_seats-1774622253138.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a3a10>
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6962%252F20476962%252Finterior_front_seats-1774634049064.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6962/20476962/interior_front_seats-1774634049064.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2f390>
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6962%252F20476962%252Finterior_boot-1774634130939.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6962/20476962/interior_boot-1774634130939.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5ce50>
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_rear_passenger-1774690968903.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_passenger-1774690968903.jpg saved to cache
2026-03-29 20:24:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4480/20464480/instrument_cluster-1774774282068.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4480/20464480/docs_service_history-1774774479753.jpg?ixlib=js-3.8.0&auto=format&s=6ab7009a4dc09eb2add9133a762fb24a> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4480/20464480/interior_boot-1774693041230.jpg> (referer: None)
2026-03-29 20:24:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3398/20423398/docs_service_history-1774625853099.jpg?ixlib=js-3.8.0&auto=format&s=ba4d9bec636a92740554921f119d24c9> (referer: None)
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item efbb061a-d82d-527d-910c-87ae802e8035 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5e750>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finstrument_cluster-1774774282068.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/instrument_cluster-1774774282068.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2be950>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4480%252F20464480%252Fdocs_service_history-1774774479753.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ab7009a4dc09eb2add9133a762fb24a') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4480/20464480/docs_service_history-1774774479753.jpg?ixlib=js-3.8.0&auto=format&s=6ab7009a4dc09eb2add9133a762fb24a saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed93810>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finterior_boot-1774693041230.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/interior_boot-1774693041230.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d186d90>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3398%252F20423398%252Fdocs_service_history-1774625853099.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba4d9bec636a92740554921f119d24c9') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3398/20423398/docs_service_history-1774625853099.jpg?ixlib=js-3.8.0&auto=format&s=ba4d9bec636a92740554921f119d24c9 saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4480/20464480/interior_front_seats-1774774421765.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3398/20423398/interior_dashboard-1774626287341.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_passenger-1774690988182.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3398/20423398/instrument_cluster-1774460035986.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3398/20423398/interior_boot-1774622083244.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4480/20464480/interior_dashboard-1774691516382.jpg> (referer: None)
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb80f10>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4480%252F20464480%252Finterior_front_seats-1774774421765.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4480/20464480/interior_front_seats-1774774421765.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb5010>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3398%252F20423398%252Finterior_dashboard-1774626287341.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3398/20423398/interior_dashboard-1774626287341.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d186a90>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_front_passenger-1774690988182.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_passenger-1774690988182.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:25 17:31:35\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\x07\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c7290>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Finstrument_cluster-1774460035986.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/instrument_cluster-1774460035986.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 14:29:03\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\x07\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:24:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb5a50>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3398%252F20423398%252Finterior_boot-1774622083244.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3398/20423398/interior_boot-1774622083244.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c26d790>
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Finterior_dashboard-1774691516382.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/interior_dashboard-1774691516382.jpg saved to cache
2026-03-29 20:24:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_rear_passenger-1774458901897.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3398/20423398/interior_front_seats-1774625401182.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_driver-1774690933768.jpg> (referer: None)
2026-03-29 20:24:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_driver-1774691089585.jpg> (referer: None)
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0a3f90>
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_rear_passenger-1774458901897.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_rear_passenger-1774458901897.jpg saved to cache
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 15:29:54\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\x07\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:24:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca78890>
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3398%252F20423398%252Finterior_front_seats-1774625401182.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3398/20423398/interior_front_seats-1774625401182.jpg saved to cache
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d102a50>
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_front_driver-1774690933768.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_driver-1774690933768.jpg saved to cache
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced6f50>
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4480%252F20464480%252Fexterior_rear_driver-1774691089585.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_driver-1774691089585.jpg saved to cache
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b175253e-5a53-568a-8e1c-8eb9b9c116cc
2026-03-29 20:24:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b175253e-5a53-568a-8e1c-8eb9b9c116cc, skipping ID generation
2026-03-29 20:24:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b175253e-5a53-568a-8e1c-8eb9b9c116cc with scrape type 1
2026-03-29 20:24:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b175253e-5a53-568a-8e1c-8eb9b9c116cc sending to next pipeline
2026-03-29 20:24:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b175253e-5a53-568a-8e1c-8eb9b9c116cc, identifier: 20464480
2026-03-29 20:24:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b175253e-5a53-568a-8e1c-8eb9b9c116cc with identifier: 20464480
2026-03-29 20:24:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b175253e-5a53-568a-8e1c-8eb9b9c116cc with identifier: 20464480
2026-03-29 20:24:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b175253e-5a53-568a-8e1c-8eb9b9c116cc with identifier: 20464480 to the API
2026-03-29 20:24:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_driver-1774691089585.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b175253e-5a53-568a-8e1c-8eb9b9c116cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RN19 OBW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20464480',
'listing': 'auction',
'location': 'Isle of Wight Sandown',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 61106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310094,
'Height': 2819,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_driver-1774690933768.jpg',
'Width': 3758},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2097809,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_driver-1774691089585.jpg',
'Width': 3687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1008740,
'Height': 2872,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_front_passenger-1774690988182.jpg',
'Width': 3829},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1888636,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4480/20464480/exterior_rear_passenger-1774690968903.jpg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1149851,
'Height': 2070,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4480/20464480/interior_front_seats-1774774421765.jpg',
'Width': 2760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2199638,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4480/20464480/interior_dashboard-1774691516382.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721668,
'Height': 2097,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4480/20464480/instrument_cluster-1774774282068.jpg',
'Width': 2796},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1712312,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4480/20464480/interior_boot-1774693041230.jpg',
'Width': 2995},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b175253e-5a53-568a-8e1c-8eb9b9c116cc/b175253e-5a53-568a-8e1c-8eb9b9c116cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1102938,
'Height': 4367,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4480/20464480/docs_service_history-1774774479753.jpg?ixlib=js-3.8.0&auto=format&s=6ab7009a4dc09eb2add9133a762fb24a',
'Width': 3275}],
'price': 11464,
'price_includes_vat': False,
'registration_date': '2019-08-23',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-Roc R-LINE TSI EVO',
'transmission': 'manual',
'trim': 'R-LINE TSI EVO',
'vin': 'WVGZZZA1ZKV177040',
'year': 2019}
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464480%27 HTTP/1.1" 200 None
2026-03-29 20:24:30 [motorway.uk] INFO: Saving data for 20464480: {'created_time': 1774815870.124243, 'last_price_update_time': 1774815870.124256, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20464480') HTTP/1.1" 204 0
2026-03-29 20:24:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_passenger-1774458906107.jpg> (referer: None)
2026-03-29 20:24:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_passenger-1774633739097.jpg> (referer: None)
2026-03-29 20:24:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_driver-1774633703301.jpg> (referer: None)
2026-03-29 20:24:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item efbb061a-d82d-527d-910c-87ae802e8035 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item efbb061a-d82d-527d-910c-87ae802e8035 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e96a710>
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3398%252F20423398%252Fexterior_front_passenger-1774458906107.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_passenger-1774458906107.jpg saved to cache
2026-03-29 20:24:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc
2026-03-29 20:24:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a494661-9ac6-5ce6-8a79-2802aef5d1bc, skipping ID generation
2026-03-29 20:24:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc with scrape type 1
2026-03-29 20:24:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a494661-9ac6-5ce6-8a79-2802aef5d1bc sending to next pipeline
2026-03-29 20:24:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8a494661-9ac6-5ce6-8a79-2802aef5d1bc, identifier: 20423398
2026-03-29 20:24:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8a494661-9ac6-5ce6-8a79-2802aef5d1bc with identifier: 20423398
2026-03-29 20:24:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8a494661-9ac6-5ce6-8a79-2802aef5d1bc with identifier: 20423398
2026-03-29 20:24:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8a494661-9ac6-5ce6-8a79-2802aef5d1bc with identifier: 20423398 to the API
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_passenger-1774458906107.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8a494661-9ac6-5ce6-8a79-2802aef5d1bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FG23 JKE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20423398',
'listing': 'auction',
'location': 'Leicestershire Derby',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 14250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344103,
'Height': 1066,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_driver-1774458908596.jpg',
'Width': 1421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558332,
'Height': 1280,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_front_passenger-1774458906107.jpg',
'Width': 1706},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551726,
'Height': 1262,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3398/20423398/exterior_rear_passenger-1774458901897.jpg',
'Width': 1682},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1281599,
'Height': 1440,
'OriginUrl': 'https://motorway-photos.imgix.net/3398/20423398/interior_front_seats-1774625401182.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1407007,
'Height': 1440,
'OriginUrl': 'https://motorway-photos.imgix.net/3398/20423398/interior_rear_seats-1774622253138.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420592,
'Height': 1440,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3398/20423398/interior_dashboard-1774626287341.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1040181,
'Height': 1440,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3398/20423398/instrument_cluster-1774460035986.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458284,
'Height': 1440,
'OriginUrl': 'https://motorway-photos.imgix.net/3398/20423398/interior_boot-1774622083244.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a494661-9ac6-5ce6-8a79-2802aef5d1bc/8a494661-9ac6-5ce6-8a79-2802aef5d1bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251020,
'Height': 1399,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3398/20423398/docs_service_history-1774625853099.jpg?ixlib=js-3.8.0&auto=format&s=ba4d9bec636a92740554921f119d24c9',
'Width': 1049}],
'price': 23509,
'price_includes_vat': False,
'registration_date': '2023-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 AMG Line PREMIUM+ MHEV A',
'transmission': 'automatic',
'trim': 'A 180 AMG Line PREMIUM+ MHEV A',
'vin': 'W1K3F8EB2PV174417',
'year': 2023}
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423398%27 HTTP/1.1" 200 None
2026-03-29 20:24:30 [motorway.uk] INFO: Saving data for 20423398: {'created_time': 1774815870.902634, 'last_price_update_time': 1774815870.902644, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20423398') HTTP/1.1" 204 0
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e96aad0>
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fexterior_front_passenger-1774633739097.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_passenger-1774633739097.jpg saved to cache
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a36d0>
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6962%252F20476962%252Fexterior_front_driver-1774633703301.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_driver-1774633703301.jpg saved to cache
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efbb061a-d82d-527d-910c-87ae802e8035
2026-03-29 20:24:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efbb061a-d82d-527d-910c-87ae802e8035, skipping ID generation
2026-03-29 20:24:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efbb061a-d82d-527d-910c-87ae802e8035 with scrape type 1
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efbb061a-d82d-527d-910c-87ae802e8035 sending to next pipeline
2026-03-29 20:24:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: efbb061a-d82d-527d-910c-87ae802e8035, identifier: 20476962
2026-03-29 20:24:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: efbb061a-d82d-527d-910c-87ae802e8035 with identifier: 20476962
2026-03-29 20:24:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: efbb061a-d82d-527d-910c-87ae802e8035 with identifier: 20476962
2026-03-29 20:24:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: efbb061a-d82d-527d-910c-87ae802e8035 with identifier: 20476962 to the API
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_driver-1774633703301.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'efbb061a-d82d-527d-910c-87ae802e8035',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'R3 KDK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20476962',
'listing': 'auction',
'location': 'Merseyside Wirral',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 16443,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1461127,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_driver-1774633703301.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1094742,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6962/20476962/exterior_front_passenger-1774633739097.jpg',
'Width': 3130},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3075407,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6962/20476962/interior_front_seats-1774634049064.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1206848,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6962/20476962/instrument_cluster-1774634165403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3218212,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6962/20476962/interior_boot-1774634130939.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1491216,
'Height': 2533,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_front_driver-1774633817056.jpg',
'Width': 3377},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efbb061a-d82d-527d-910c-87ae802e8035/efbb061a-d82d-527d-910c-87ae802e8035_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 748829,
'Height': 1817,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6962/20476962/wheels_rear_driver-1774633837373.jpg',
'Width': 2423}],
'price': 11562,
'price_includes_vat': False,
'registration_date': '2024-08-31',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot Partner Professional L1 Bhdi',
'transmission': 'manual',
'trim': 'Professional L1 Bhdi',
'vin': 'VR3EDYHT6RJ825814',
'year': 2024}
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476962%27 HTTP/1.1" 200 None
2026-03-29 20:24:31 [motorway.uk] INFO: Saving data for 20476962: {'created_time': 1774815871.829627, 'last_price_update_time': 1774815871.829637, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20476962') HTTP/1.1" 204 0
2026-03-29 20:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_front_driver-1774616191161.jpg> (referer: None)
2026-03-29 20:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1522/20471522/interior_front_seats-1774616596975.jpg> (referer: None)
2026-03-29 20:24:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_rear_passenger-1774616232795.jpg> (referer: None)
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24c510>
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Fexterior_front_driver-1774616191161.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_front_driver-1774616191161.jpg saved to cache
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:24:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:24:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24e5d0>
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1522%252F20471522%252Finterior_front_seats-1774616596975.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1522/20471522/interior_front_seats-1774616596975.jpg saved to cache
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e968110>
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1522%252F20471522%252Fexterior_rear_passenger-1774616232795.jpg') HTTP/1.1" 204 0
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_rear_passenger-1774616232795.jpg saved to cache
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bebf1244-c9fc-5d4e-aa60-74871fe312eb
2026-03-29 20:24:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bebf1244-c9fc-5d4e-aa60-74871fe312eb, skipping ID generation
2026-03-29 20:24:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebf1244-c9fc-5d4e-aa60-74871fe312eb with scrape type 1
2026-03-29 20:24:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bebf1244-c9fc-5d4e-aa60-74871fe312eb sending to next pipeline
2026-03-29 20:24:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bebf1244-c9fc-5d4e-aa60-74871fe312eb, identifier: 20471522
2026-03-29 20:24:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bebf1244-c9fc-5d4e-aa60-74871fe312eb with identifier: 20471522
2026-03-29 20:24:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bebf1244-c9fc-5d4e-aa60-74871fe312eb with identifier: 20471522
2026-03-29 20:24:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bebf1244-c9fc-5d4e-aa60-74871fe312eb with identifier: 20471522 to the API
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:24:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_rear_passenger-1774616232795.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'bebf1244-c9fc-5d4e-aa60-74871fe312eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WN19 WTX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471522',
'listing': 'auction',
'location': 'None None',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 37405,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1529532,
'Height': 2550,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_front_driver-1774616191161.jpg',
'Width': 3400},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1551778,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1522/20471522/exterior_rear_passenger-1774616232795.jpg',
'Width': 3407},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3121469,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1522/20471522/interior_front_seats-1774616596975.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3373339,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1522/20471522/interior_rear_seats-1774616614962.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727935,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1522/20471522/interior_dashboard-1774616655733.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192376,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1522/20471522/instrument_cluster-1774616798917.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3711653,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1522/20471522/interior_boot-1774618037729.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebf1244-c9fc-5d4e-aa60-74871fe312eb/bebf1244-c9fc-5d4e-aa60-74871fe312eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1651354,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1522/20471522/damage_warning_lights-1774618229433.jpg',
'Width': 4032}],
'price': 15028,
'price_includes_vat': False,
'registration_date': '2019-03-19',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 220 AMG Line Nght ED + D A',
'transmission': 'automatic',
'trim': 'CLA 220 AMG Line Nght ED + D A',
'vin': 'WDD1179032N765296',
'year': 2019}
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471522%27 HTTP/1.1" 200 None
2026-03-29 20:24:32 [motorway.uk] INFO: Saving data for 20471522: {'created_time': 1774815872.880492, 'last_price_update_time': 1774815872.880509, 'auction_closing_time': 1774884600.0}
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471522') HTTP/1.1" 204 0
2026-03-29 20:24:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.810(s), this was the 1st time calling it.
2026-03-29 20:24:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.691739149023995 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:24:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20217991.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec with identifier: 20217991
2026-03-29 20:24:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec with scrape type 1
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_front_driver-1774690959353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_driver-1774690959353.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_rear_driver-1774690956799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_driver-1774690956799.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_front_passenger-1774690959756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_passenger-1774690959756.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_rear_passenger-1774690961190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_passenger-1774690961190.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7991%252F20217991%252Finterior_front_seats-1774691464975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7991/20217991/interior_front_seats-1774691464975.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7991%252F20217991%252Finterior_rear_seats-1774691465684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7991/20217991/interior_rear_seats-1774691465684.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Finterior_dashboard-1774691510331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/interior_dashboard-1774691510331.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Finstrument_cluster-1774691527456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/instrument_cluster-1774691527456.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7991%252F20217991%252Finterior_boot-1774691468082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7991/20217991/interior_boot-1774691468082.jpg not downloaded yet
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7991%252F20217991%252Fdocs_service_history-1774691551960.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D83b435b7d4b5183aee3c0d60b04de60d%27 HTTP/1.1" 200 None
2026-03-29 20:24:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7991/20217991/docs_service_history-1774691551960.jpg?ixlib=js-3.8.0&auto=format&s=83b435b7d4b5183aee3c0d60b04de60d not downloaded yet
2026-03-29 20:24:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:24:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.924(s), this was the 1st time calling it.
2026-03-29 20:24:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.815176270503255 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3620067.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:24:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:24:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d057e1e1-cd1b-52ed-928c-72eedc534c62 with identifier: 3620067
2026-03-29 20:24:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d057e1e1-cd1b-52ed-928c-72eedc534c62 with scrape type 1
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_front_driver-1774693548426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_driver-1774693548426.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_rear_driver-1774693604865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_driver-1774693604865.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_front_passenger-1774693628712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_passenger-1774693628712.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_rear_passenger-1774625943022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_passenger-1774625943022.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Finterior_front_seats-1774625994589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/interior_front_seats-1774625994589.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Finterior_rear_seats-1774693638483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/interior_rear_seats-1774693638483.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Finterior_dashboard-1774625991035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/interior_dashboard-1774625991035.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Finterior_boot-1774625966272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/interior_boot-1774625966272.jpg not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0067%252F3620067%252Fdocs_service_history-1774693811217.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db70b7325e10751e84d698da489c665cc%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0067/3620067/docs_service_history-1774693811217.jpg?ixlib=js-3.8.0&auto=format&s=b70b7325e10751e84d698da489c665cc not downloaded yet
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Fwheels_front_driver-1774693648107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:24:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/wheels_front_driver-1774693648107.jpg not downloaded yet
2026-03-29 20:24:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7991/20217991/docs_service_history-1774691551960.jpg?ixlib=js-3.8.0&auto=format&s=83b435b7d4b5183aee3c0d60b04de60d> (referer: None)
2026-03-29 20:24:59 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x04\xb0'
2026-03-29 20:24:59 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x06@'
2026-03-29 20:24:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00>'
2026-03-29 20:24:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:24:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:24:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e92b610>
2026-03-29 20:24:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:24:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:24:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7991%252F20217991%252Fdocs_service_history-1774691551960.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D83b435b7d4b5183aee3c0d60b04de60d') HTTP/1.1" 204 0
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7991/20217991/docs_service_history-1774691551960.jpg?ixlib=js-3.8.0&auto=format&s=83b435b7d4b5183aee3c0d60b04de60d saved to cache
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0067/3620067/wheels_front_driver-1774693648107.jpg> (referer: None)
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e928190>
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Fwheels_front_driver-1774693648107.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/wheels_front_driver-1774693648107.jpg saved to cache
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0067/3620067/docs_service_history-1774693811217.jpg?ixlib=js-3.8.0&auto=format&s=b70b7325e10751e84d698da489c665cc> (referer: None)
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0a1310>
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0067%252F3620067%252Fdocs_service_history-1774693811217.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db70b7325e10751e84d698da489c665cc') HTTP/1.1" 204 0
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0067/3620067/docs_service_history-1774693811217.jpg?ixlib=js-3.8.0&auto=format&s=b70b7325e10751e84d698da489c665cc saved to cache
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0067/3620067/interior_boot-1774625966272.jpg> (referer: None)
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0a3990>
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Finterior_boot-1774625966272.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/interior_boot-1774625966272.jpg saved to cache
2026-03-29 20:25:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0067/3620067/interior_dashboard-1774625991035.jpg> (referer: None)
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3f8d10>
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Finterior_dashboard-1774625991035.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/interior_dashboard-1774625991035.jpg saved to cache
2026-03-29 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0067/3620067/interior_rear_seats-1774693638483.jpg> (referer: None)
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d187fd0>
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Finterior_rear_seats-1774693638483.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/interior_rear_seats-1774693638483.jpg saved to cache
2026-03-29 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0067/3620067/interior_front_seats-1774625994589.jpg> (referer: None)
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c239c50>
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0067%252F3620067%252Finterior_front_seats-1774625994589.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0067/3620067/interior_front_seats-1774625994589.jpg saved to cache
2026-03-29 20:25:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_passenger-1774625943022.jpg> (referer: None)
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3fb5d0>
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_rear_passenger-1774625943022.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_passenger-1774625943022.jpg saved to cache
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_passenger-1774693628712.jpg> (referer: None)
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24f9d0>
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_front_passenger-1774693628712.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_passenger-1774693628712.jpg saved to cache
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_driver-1774693604865.jpg> (referer: None)
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc03650>
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_rear_driver-1774693604865.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_driver-1774693604865.jpg saved to cache
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_driver-1774693548426.jpg> (referer: None)
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24eb90>
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0067%252F3620067%252Fexterior_front_driver-1774693548426.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_driver-1774693548426.jpg saved to cache
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d057e1e1-cd1b-52ed-928c-72eedc534c62
2026-03-29 20:25:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d057e1e1-cd1b-52ed-928c-72eedc534c62, skipping ID generation
2026-03-29 20:25:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d057e1e1-cd1b-52ed-928c-72eedc534c62 with scrape type 1
2026-03-29 20:25:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d057e1e1-cd1b-52ed-928c-72eedc534c62 sending to next pipeline
2026-03-29 20:25:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d057e1e1-cd1b-52ed-928c-72eedc534c62, identifier: 3620067
2026-03-29 20:25:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d057e1e1-cd1b-52ed-928c-72eedc534c62 with identifier: 3620067
2026-03-29 20:25:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d057e1e1-cd1b-52ed-928c-72eedc534c62 with identifier: 3620067
2026-03-29 20:25:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d057e1e1-cd1b-52ed-928c-72eedc534c62 with identifier: 3620067 to the API
2026-03-29 20:25:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_driver-1774693548426.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd057e1e1-cd1b-52ed-928c-72eedc534c62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OE15 BYK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3620067',
'listing': 'auction',
'location': 'Lancashire Burnley',
'make': 'Honda',
'model': 'CR-V',
'odometer': 44000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66952,
'Height': 512,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_driver-1774693548426.jpg',
'Width': 683},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63569,
'Height': 526,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_driver-1774693604865.jpg',
'Width': 701},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78724,
'Height': 598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_front_passenger-1774693628712.jpg',
'Width': 797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1390102,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0067/3620067/exterior_rear_passenger-1774625943022.jpg',
'Width': 3571},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2483306,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0067/3620067/interior_front_seats-1774625994589.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96409,
'Height': 600,
'OriginUrl': 'https://motorway-photos.imgix.net/0067/3620067/interior_rear_seats-1774693638483.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928811,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0067/3620067/interior_dashboard-1774625991035.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757363,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0067/3620067/interior_boot-1774625966272.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671329,
'Height': 1318,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0067/3620067/docs_service_history-1774693811217.jpg?ixlib=js-3.8.0&auto=format&s=b70b7325e10751e84d698da489c665cc',
'Width': 1757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e1e1-cd1b-52ed-928c-72eedc534c62/d057e1e1-cd1b-52ed-928c-72eedc534c62_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115987,
'Height': 675,
'OriginUrl': 'https://motorway-photos.imgix.net/0067/3620067/wheels_front_driver-1774693648107.jpg',
'Width': 900}],
'price': 11298,
'price_includes_vat': False,
'registration_date': '2015-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Honda CR-V EX i-DTEC Auto',
'transmission': 'automatic',
'trim': 'EX i-DTEC Auto',
'vin': 'SHSRE6890EU018500',
'year': 2015}
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273620067%27 HTTP/1.1" 200 None
2026-03-29 20:25:03 [motorway.uk] INFO: Saving data for 3620067: {'created_time': 1774815903.245193, 'last_price_update_time': 1774815903.245208, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3620067') HTTP/1.1" 204 0
2026-03-29 20:25:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7991/20217991/interior_boot-1774691468082.jpg> (referer: None)
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c239310>
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7991%252F20217991%252Finterior_boot-1774691468082.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7991/20217991/interior_boot-1774691468082.jpg saved to cache
2026-03-29 20:25:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7991/20217991/instrument_cluster-1774691527456.jpg> (referer: None)
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24f090>
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Finstrument_cluster-1774691527456.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/instrument_cluster-1774691527456.jpg saved to cache
2026-03-29 20:25:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18824482.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7991/20217991/interior_dashboard-1774691510331.jpg> (referer: None)
2026-03-29 20:25:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c43733-dea0-5114-ba39-5a8b0cab0d7b with identifier: 18824482
2026-03-29 20:25:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b with scrape type 1
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_front_driver-1774702495791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_driver-1774702495791.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_rear_driver-1774702430568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_driver-1774702430568.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_front_passenger-1774702514315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_passenger-1774702514315.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_rear_passenger-1774702440967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_passenger-1774702440967.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F18824482%252Finterior_front_seats-1774703923689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/18824482/interior_front_seats-1774703923689.jpg not downloaded yet
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e92b690>
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Finterior_dashboard-1774691510331.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/interior_dashboard-1774691510331.jpg saved to cache
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F18824482%252Finterior_rear_seats-1774703932411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/18824482/interior_rear_seats-1774703932411.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Finterior_dashboard-1774703967652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/interior_dashboard-1774703967652.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Finstrument_cluster-1774704024853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/instrument_cluster-1774704024853.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F18824482%252Finterior_boot-1774703996285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/18824482/interior_boot-1774703996285.jpg not downloaded yet
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4482%252F18824482%252Fdocs_service_history-1774704104579.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D78d0910f3dc2daf55733cd96d21b49fd%27 HTTP/1.1" 200 None
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4482/18824482/docs_service_history-1774704104579.jpg?ixlib=js-3.8.0&auto=format&s=78d0910f3dc2daf55733cd96d21b49fd not downloaded yet
2026-03-29 20:25:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7991/20217991/interior_rear_seats-1774691465684.jpg> (referer: None)
2026-03-29 20:25:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7991/20217991/interior_front_seats-1774691464975.jpg> (referer: None)
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec74550>
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7991%252F20217991%252Finterior_rear_seats-1774691465684.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7991/20217991/interior_rear_seats-1774691465684.jpg saved to cache
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce663d0>
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7991%252F20217991%252Finterior_front_seats-1774691464975.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7991/20217991/interior_front_seats-1774691464975.jpg saved to cache
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4482/18824482/interior_boot-1774703996285.jpg> (referer: None)
2026-03-29 20:25:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb978d0>
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F18824482%252Finterior_boot-1774703996285.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/18824482/interior_boot-1774703996285.jpg saved to cache
2026-03-29 20:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/18824482/instrument_cluster-1774704024853.jpg> (referer: None)
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce67590>
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Finstrument_cluster-1774704024853.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/instrument_cluster-1774704024853.jpg saved to cache
2026-03-29 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4482/18824482/docs_service_history-1774704104579.jpg?ixlib=js-3.8.0&auto=format&s=78d0910f3dc2daf55733cd96d21b49fd> (referer: None)
2026-03-29 20:25:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/18824482/interior_dashboard-1774703967652.jpg> (referer: None)
2026-03-29 20:25:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:25:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:25:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:05 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb959d0>
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4482%252F18824482%252Fdocs_service_history-1774704104579.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D78d0910f3dc2daf55733cd96d21b49fd') HTTP/1.1" 204 0
2026-03-29 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4482/18824482/docs_service_history-1774704104579.jpg?ixlib=js-3.8.0&auto=format&s=78d0910f3dc2daf55733cd96d21b49fd saved to cache
2026-03-29 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec75ed0>
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Finterior_dashboard-1774703967652.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/interior_dashboard-1774703967652.jpg saved to cache
2026-03-29 20:25:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:05 [scrapy.extensions.logstats] INFO: Crawled 226 pages (at 15 pages/min), scraped 176 items (at 11 items/min)
2026-03-29 20:25:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:25:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4482/18824482/interior_front_seats-1774703923689.jpg> (referer: None)
2026-03-29 20:25:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4482/18824482/interior_rear_seats-1774703932411.jpg> (referer: None)
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec74ad0>
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F18824482%252Finterior_front_seats-1774703923689.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/18824482/interior_front_seats-1774703923689.jpg saved to cache
2026-03-29 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c239dd0>
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F18824482%252Finterior_rear_seats-1774703932411.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/18824482/interior_rear_seats-1774703932411.jpg saved to cache
2026-03-29 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_passenger-1774702440967.jpg> (referer: None)
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf4090>
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_rear_passenger-1774702440967.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_passenger-1774702440967.jpg saved to cache
2026-03-29 20:25:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_passenger-1774702514315.jpg> (referer: None)
2026-03-29 20:25:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_driver-1774702430568.jpg> (referer: None)
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23bf50>
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_front_passenger-1774702514315.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_passenger-1774702514315.jpg saved to cache
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec75c90>
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_rear_driver-1774702430568.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_driver-1774702430568.jpg saved to cache
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_passenger-1774690961190.jpg> (referer: None)
2026-03-29 20:25:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_driver-1774702495791.jpg> (referer: None)
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb96dd0>
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_rear_passenger-1774690961190.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_passenger-1774690961190.jpg saved to cache
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d117410>
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F18824482%252Fexterior_front_driver-1774702495791.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_driver-1774702495791.jpg saved to cache
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b
2026-03-29 20:25:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3c43733-dea0-5114-ba39-5a8b0cab0d7b, skipping ID generation
2026-03-29 20:25:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b with scrape type 1
2026-03-29 20:25:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3c43733-dea0-5114-ba39-5a8b0cab0d7b sending to next pipeline
2026-03-29 20:25:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b3c43733-dea0-5114-ba39-5a8b0cab0d7b, identifier: 18824482
2026-03-29 20:25:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b3c43733-dea0-5114-ba39-5a8b0cab0d7b with identifier: 18824482
2026-03-29 20:25:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b3c43733-dea0-5114-ba39-5a8b0cab0d7b with identifier: 18824482
2026-03-29 20:25:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b3c43733-dea0-5114-ba39-5a8b0cab0d7b with identifier: 18824482 to the API
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_driver-1774702495791.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b3c43733-dea0-5114-ba39-5a8b0cab0d7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KT67 WPW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18824482',
'listing': 'auction',
'location': 'Oxfordshire Bicester',
'make': 'Mercedes',
'model': 'E Class',
'odometer': 79000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1999877,
'Height': 2944,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_driver-1774702495791.jpg',
'Width': 3925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2389211,
'Height': 2930,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_driver-1774702430568.jpg',
'Width': 3907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977048,
'Height': 2838,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_front_passenger-1774702514315.jpg',
'Width': 3784},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2117367,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4482/18824482/exterior_rear_passenger-1774702440967.jpg',
'Width': 3966},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4614316,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4482/18824482/interior_front_seats-1774703923689.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3704865,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4482/18824482/interior_rear_seats-1774703932411.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1697360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4482/18824482/interior_dashboard-1774703967652.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1390733,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4482/18824482/instrument_cluster-1774704024853.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3563929,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4482/18824482/interior_boot-1774703996285.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c43733-dea0-5114-ba39-5a8b0cab0d7b/b3c43733-dea0-5114-ba39-5a8b0cab0d7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6779807,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4482/18824482/docs_service_history-1774704104579.jpg?ixlib=js-3.8.0&auto=format&s=78d0910f3dc2daf55733cd96d21b49fd',
'Width': 4032}],
'price': 14282,
'price_includes_vat': False,
'registration_date': '2018-01-15',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes E 350 D AMG Line 4MATIC Auto',
'transmission': 'automatic',
'trim': 'E 350 D AMG Line 4MATIC Auto',
'vin': 'WDD2383342F042540',
'year': 2018}
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718824482%27 HTTP/1.1" 200 None
2026-03-29 20:25:08 [motorway.uk] INFO: Saving data for 18824482: {'created_time': 1774815908.390607, 'last_price_update_time': 1774815908.39062, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18824482') HTTP/1.1" 204 0
2026-03-29 20:25:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_driver-1774690956799.jpg> (referer: None)
2026-03-29 20:25:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_passenger-1774690959756.jpg> (referer: None)
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce67250>
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_rear_driver-1774690956799.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_driver-1774690956799.jpg saved to cache
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d117510>
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_front_passenger-1774690959756.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_passenger-1774690959756.jpg saved to cache
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_driver-1774690959353.jpg> (referer: None)
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec778d0>
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7991%252F20217991%252Fexterior_front_driver-1774690959353.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_driver-1774690959353.jpg saved to cache
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec
2026-03-29 20:25:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec, skipping ID generation
2026-03-29 20:25:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec with scrape type 1
2026-03-29 20:25:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec sending to next pipeline
2026-03-29 20:25:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec, identifier: 20217991
2026-03-29 20:25:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec with identifier: 20217991
2026-03-29 20:25:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec with identifier: 20217991
2026-03-29 20:25:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8cd730da-8d0d-5d5d-a46e-cef791c1a2ec with identifier: 20217991 to the API
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_driver-1774690959353.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8cd730da-8d0d-5d5d-a46e-cef791c1a2ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY67 AAU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20217991',
'listing': 'auction',
'location': 'Northumberland Blyth',
'make': 'Peugeot',
'model': '208',
'odometer': 36817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763090,
'Height': 2520,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_driver-1774690959353.jpg',
'Width': 3360},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1439923,
'Height': 2133,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_driver-1774690956799.jpg',
'Width': 2844},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2262690,
'Height': 2814,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_front_passenger-1774690959756.jpg',
'Width': 3752},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1579025,
'Height': 2575,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7991/20217991/exterior_rear_passenger-1774690961190.jpg',
'Width': 3433},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2427772,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7991/20217991/interior_front_seats-1774691464975.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1862138,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7991/20217991/interior_rear_seats-1774691465684.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1864926,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7991/20217991/interior_dashboard-1774691510331.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488555,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7991/20217991/instrument_cluster-1774691527456.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2116455,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7991/20217991/interior_boot-1774691468082.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cd730da-8d0d-5d5d-a46e-cef791c1a2ec/8cd730da-8d0d-5d5d-a46e-cef791c1a2ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3851828,
'Height': 2636,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7991/20217991/docs_service_history-1774691551960.jpg?ixlib=js-3.8.0&auto=format&s=83b435b7d4b5183aee3c0d60b04de60d',
'Width': 3832}],
'price': 6814,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 208 GTI Prestige THP',
'transmission': 'manual',
'trim': 'GTI Prestige THP',
'vin': 'VF3CA5GRMHW139824',
'year': 2017}
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720217991%27 HTTP/1.1" 200 None
2026-03-29 20:25:09 [motorway.uk] INFO: Saving data for 20217991: {'created_time': 1774815909.84466, 'last_price_update_time': 1774815909.844671, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20217991') HTTP/1.1" 204 0
2026-03-29 20:25:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1308/19601308/interior_rear_seats-1774628944765.jpg> (referer: None)
2026-03-29 20:25:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec75f90>
2026-03-29 20:25:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1308%252F19601308%252Finterior_rear_seats-1774628944765.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1308/19601308/interior_rear_seats-1774628944765.jpg saved to cache
2026-03-29 20:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:25:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_passenger-1774628436598.jpg> (referer: None)
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb97090>
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_rear_passenger-1774628436598.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_passenger-1774628436598.jpg saved to cache
2026-03-29 20:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:25:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_passenger-1774628451607.jpg> (referer: None)
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11c1d0>
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_front_passenger-1774628451607.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_passenger-1774628451607.jpg saved to cache
2026-03-29 20:25:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:25:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_driver-1774628427182.jpg> (referer: None)
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb954d0>
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_rear_driver-1774628427182.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_driver-1774628427182.jpg saved to cache
2026-03-29 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:25:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_driver-1774628409202.jpg> (referer: None)
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11e690>
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1308%252F19601308%252Fexterior_front_driver-1774628409202.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_driver-1774628409202.jpg saved to cache
2026-03-29 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6e129e7-8911-504d-8901-28afd2cd45a7
2026-03-29 20:25:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6e129e7-8911-504d-8901-28afd2cd45a7, skipping ID generation
2026-03-29 20:25:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6e129e7-8911-504d-8901-28afd2cd45a7 with scrape type 1
2026-03-29 20:25:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6e129e7-8911-504d-8901-28afd2cd45a7 sending to next pipeline
2026-03-29 20:25:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f6e129e7-8911-504d-8901-28afd2cd45a7, identifier: 19601308
2026-03-29 20:25:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f6e129e7-8911-504d-8901-28afd2cd45a7 with identifier: 19601308
2026-03-29 20:25:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f6e129e7-8911-504d-8901-28afd2cd45a7 with identifier: 19601308
2026-03-29 20:25:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f6e129e7-8911-504d-8901-28afd2cd45a7 with identifier: 19601308 to the API
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_driver-1774628409202.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'f6e129e7-8911-504d-8901-28afd2cd45a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ17 NNR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19601308',
'listing': 'auction',
'location': 'Worcestershire Droitwich',
'make': 'Volkswagen',
'model': 'Transporter',
'odometer': 78456,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779343,
'Height': 1904,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_driver-1774628409202.jpg',
'Width': 2539},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1215234,
'Height': 2231,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_driver-1774628427182.jpg',
'Width': 2974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1883345,
'Height': 2708,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_front_passenger-1774628451607.jpg',
'Width': 3611},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202738,
'Height': 2506,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1308/19601308/exterior_rear_passenger-1774628436598.jpg',
'Width': 3341},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3048458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1308/19601308/interior_front_seats-1774628755441.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3476245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1308/19601308/interior_rear_seats-1774628944765.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3101300,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1308/19601308/interior_dashboard-1774628805717.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3510770,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1308/19601308/instrument_cluster-1774628845652.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3029082,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1308/19601308/interior_boot-1774628815170.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e129e7-8911-504d-8901-28afd2cd45a7/f6e129e7-8911-504d-8901-28afd2cd45a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2711375,
'Height': 2798,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1308/19601308/docs_service_history-1774690969685.jpg?ixlib=js-3.8.0&auto=format&s=04fa25fc9ac73e0b18475b269b6dee0d',
'Width': 1894}],
'price': 19693,
'price_includes_vat': False,
'registration_date': '2017-06-15',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen TR-SPORTER T32 Sptln Tdibmt SA',
'transmission': 'automatic',
'trim': 'TR-SPORTER T32 Sptln Tdibmt SA',
'vin': 'WV1ZZZ7HZHH043583',
'year': 2017}
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719601308%27 HTTP/1.1" 200 None
2026-03-29 20:25:11 [motorway.uk] INFO: Saving data for 19601308: {'created_time': 1774815911.730957, 'last_price_update_time': 1774815911.730966, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19601308') HTTP/1.1" 204 0
2026-03-29 20:25:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5321/19815321/instrument_cluster-1774782548488.jpg> (referer: None)
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11f410>
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finstrument_cluster-1774782548488.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/instrument_cluster-1774782548488.jpg saved to cache
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5321/19815321/interior_dashboard-1774784217147.jpg> (referer: None)
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e977050>
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finterior_dashboard-1774784217147.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/interior_dashboard-1774784217147.jpg saved to cache
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5321/19815321/interior_front_seats-1774784178648.jpg> (referer: None)
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb94310>
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5321%252F19815321%252Finterior_front_seats-1774784178648.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5321/19815321/interior_front_seats-1774784178648.jpg saved to cache
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_passenger-1774699031209.jpg> (referer: None)
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e974790>
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_rear_passenger-1774699031209.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_passenger-1774699031209.jpg saved to cache
2026-03-29 20:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_passenger-1774699116238.jpg> (referer: None)
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec76950>
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_front_passenger-1774699116238.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_passenger-1774699116238.jpg saved to cache
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_driver-1773577263984.jpg> (referer: None)
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976710>
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_rear_driver-1773577263984.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_driver-1773577263984.jpg saved to cache
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_driver-1773577258189.jpg> (referer: None)
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c239310>
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5321%252F19815321%252Fexterior_front_driver-1773577258189.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_driver-1773577258189.jpg saved to cache
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef
2026-03-29 20:25:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf02d2fc-1edc-5732-945c-caf7ff13f1ef, skipping ID generation
2026-03-29 20:25:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef with scrape type 1
2026-03-29 20:25:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf02d2fc-1edc-5732-945c-caf7ff13f1ef sending to next pipeline
2026-03-29 20:25:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cf02d2fc-1edc-5732-945c-caf7ff13f1ef, identifier: 19815321
2026-03-29 20:25:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cf02d2fc-1edc-5732-945c-caf7ff13f1ef with identifier: 19815321
2026-03-29 20:25:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cf02d2fc-1edc-5732-945c-caf7ff13f1ef with identifier: 19815321
2026-03-29 20:25:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cf02d2fc-1edc-5732-945c-caf7ff13f1ef with identifier: 19815321 to the API
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_driver-1773577258189.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cf02d2fc-1edc-5732-945c-caf7ff13f1ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG17 ODY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19815321',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Ford',
'model': 'Transit',
'odometer': 130437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771694,
'Height': 2179,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_driver-1773577258189.jpg',
'Width': 2905},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629770,
'Height': 2137,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_driver-1773577263984.jpg',
'Width': 2849},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1572566,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_front_passenger-1774699116238.jpg',
'Width': 3554},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625369,
'Height': 1910,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5321/19815321/exterior_rear_passenger-1774699031209.jpg',
'Width': 2546},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726324,
'Height': 1769,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5321/19815321/interior_front_seats-1774784178648.jpg',
'Width': 2359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791625,
'Height': 1658,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5321/19815321/interior_dashboard-1774784217147.jpg',
'Width': 2211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623187,
'Height': 1777,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5321/19815321/instrument_cluster-1774782548488.jpg',
'Width': 2370},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1082716,
'Height': 2089,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5321/19815321/interior_boot-1774782541764.jpg',
'Width': 2785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8338572,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/5321/19815321/damage_scratches-1773575811267.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf02d2fc-1edc-5732-945c-caf7ff13f1ef/cf02d2fc-1edc-5732-945c-caf7ff13f1ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41241,
'Height': 455,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5321/19815321/damage_missing_trims-1774782520217.jpg',
'Width': 606}],
'price': 5583,
'price_includes_vat': False,
'registration_date': '2017-03-21',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Custom 270 Limited',
'transmission': 'manual',
'trim': 'Custom 270 Limited',
'vin': 'WF0YXXTTGYHJ65035',
'year': 2017}
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719815321%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [motorway.uk] INFO: Saving data for 19815321: {'created_time': 1774815914.084639, 'last_price_update_time': 1774815914.084649, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19815321') HTTP/1.1" 204 0
2026-03-29 20:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1256/20471256/exterior_rear_driver-1774696899121.jpg> (referer: None)
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce662d0>
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1256%252F20471256%252Fexterior_rear_driver-1774696899121.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1256/20471256/exterior_rear_driver-1774696899121.jpg saved to cache
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20306533.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5c3d813-194e-5764-a42e-84268ee37012 with identifier: 20306533
2026-03-29 20:25:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5c3d813-194e-5764-a42e-84268ee37012 with scrape type 1
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_front_driver-1774701908125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_driver-1774701908125.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_rear_driver-1774701975169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_driver-1774701975169.jpg not downloaded yet
2026-03-29 20:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_driver-1774696887685.jpg> (referer: None)
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_front_passenger-1774701998620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_passenger-1774701998620.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_rear_passenger-1774701986417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_passenger-1774701986417.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6533%252F20306533%252Finterior_front_seats-1774702476307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6533/20306533/interior_front_seats-1774702476307.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6533%252F20306533%252Finterior_rear_seats-1774702527002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6533/20306533/interior_rear_seats-1774702527002.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6533%252F20306533%252F20306533-interior_dashboard-modified-1774704397403.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6533/20306533/20306533-interior_dashboard-modified-1774704397403.jpeg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Finstrument_cluster-1774702632881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/instrument_cluster-1774702632881.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6533%252F20306533%252Finterior_boot-1774702421755.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6533/20306533/interior_boot-1774702421755.jpg not downloaded yet
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6533%252F20306533%252Fdocs_service_history-1774702883327.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8d5603ba6894e22092621808bdc4c10%27 HTTP/1.1" 200 None
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6533/20306533/docs_service_history-1774702883327.jpg?ixlib=js-3.8.0&auto=format&s=d8d5603ba6894e22092621808bdc4c10 not downloaded yet
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11e2d0>
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1256%252F20471256%252Fexterior_front_driver-1774696887685.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_driver-1774696887685.jpg saved to cache
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1195f0a-264f-56e1-b005-c5ed3e01abbf
2026-03-29 20:25:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1195f0a-264f-56e1-b005-c5ed3e01abbf, skipping ID generation
2026-03-29 20:25:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1195f0a-264f-56e1-b005-c5ed3e01abbf with scrape type 1
2026-03-29 20:25:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1195f0a-264f-56e1-b005-c5ed3e01abbf sending to next pipeline
2026-03-29 20:25:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d1195f0a-264f-56e1-b005-c5ed3e01abbf, identifier: 20471256
2026-03-29 20:25:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d1195f0a-264f-56e1-b005-c5ed3e01abbf with identifier: 20471256
2026-03-29 20:25:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d1195f0a-264f-56e1-b005-c5ed3e01abbf with identifier: 20471256
2026-03-29 20:25:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d1195f0a-264f-56e1-b005-c5ed3e01abbf with identifier: 20471256 to the API
2026-03-29 20:25:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_driver-1774696887685.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd1195f0a-264f-56e1-b005-c5ed3e01abbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ22 OXD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471256',
'listing': 'auction',
'location': 'West Midlands Sutton Coldfield',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 37778,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597101,
'Height': 2792,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_driver-1774696887685.jpg',
'Width': 3723},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1780927,
'Height': 2422,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1256/20471256/exterior_rear_driver-1774696899121.jpg',
'Width': 3229},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1691874,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1256/20471256/exterior_front_passenger-1774696920234.jpg',
'Width': 3335},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593617,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20471256/exterior_rear_passenger-1774693908956.jpg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4020558,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20471256/interior_front_seats-1774694528222.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4044911,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20471256/interior_rear_seats-1774694560750.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1026451,
'Height': 1500,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20471256/interior_dashboard-1774616620805.jpg',
'Width': 2000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765847,
'Height': 1500,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20471256/instrument_cluster-1774617477503.jpg',
'Width': 2000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862807,
'Height': 1500,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20471256/interior_boot-1774616774976.jpg',
'Width': 2000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1195f0a-264f-56e1-b005-c5ed3e01abbf/d1195f0a-264f-56e1-b005-c5ed3e01abbf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1150471,
'Height': 2508,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1256/20471256/docs_service_history-1774695083285.jpg?ixlib=js-3.8.0&auto=format&s=a4668ecaf2057adf91f6d32b0d127301',
'Width': 3941}],
'price': 21319,
'price_includes_vat': False,
'registration_date': '2022-05-28',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 220 AMG Line ED Prem D A',
'transmission': 'automatic',
'trim': 'C 220 AMG Line ED Prem D A',
'vin': 'W1K2054142G109959',
'year': 2022}
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471256%27 HTTP/1.1" 200 None
2026-03-29 20:25:16 [motorway.uk] INFO: Saving data for 20471256: {'created_time': 1774815916.033643, 'last_price_update_time': 1774815916.033658, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471256') HTTP/1.1" 204 0
2026-03-29 20:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_driver-1774701975169.jpg> (referer: None)
2026-03-29 20:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2457/3792457/docs_service_history-1774708752817.jpg?ixlib=js-3.8.0&auto=format&s=e243fa8eb5c2f445f1c7e98ead254b63> (referer: None)
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc15428b90>
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_rear_driver-1774701975169.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_driver-1774701975169.jpg saved to cache
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb7250>
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2457%252F3792457%252Fdocs_service_history-1774708752817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De243fa8eb5c2f445f1c7e98ead254b63') HTTP/1.1" 204 0
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2457/3792457/docs_service_history-1774708752817.jpg?ixlib=js-3.8.0&auto=format&s=e243fa8eb5c2f445f1c7e98ead254b63 saved to cache
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6533/20306533/interior_boot-1774702421755.jpg> (referer: None)
2026-03-29 20:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6533/20306533/docs_service_history-1774702883327.jpg?ixlib=js-3.8.0&auto=format&s=d8d5603ba6894e22092621808bdc4c10> (referer: None)
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc15428690>
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6533%252F20306533%252Finterior_boot-1774702421755.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6533/20306533/interior_boot-1774702421755.jpg saved to cache
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e6d50>
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6533%252F20306533%252Fdocs_service_history-1774702883327.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8d5603ba6894e22092621808bdc4c10') HTTP/1.1" 204 0
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6533/20306533/docs_service_history-1774702883327.jpg?ixlib=js-3.8.0&auto=format&s=d8d5603ba6894e22092621808bdc4c10 saved to cache
2026-03-29 20:25:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6533/20306533/instrument_cluster-1774702632881.jpg> (referer: None)
2026-03-29 20:25:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6533/20306533/20306533-interior_dashboard-modified-1774704397403.jpeg> (referer: None)
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d186190>
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Finstrument_cluster-1774702632881.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/instrument_cluster-1774702632881.jpg saved to cache
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e065710>
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6533%252F20306533%252F20306533-interior_dashboard-modified-1774704397403.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6533/20306533/20306533-interior_dashboard-modified-1774704397403.jpeg saved to cache
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6533/20306533/interior_rear_seats-1774702527002.jpg> (referer: None)
2026-03-29 20:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6533/20306533/interior_front_seats-1774702476307.jpg> (referer: None)
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb5fd0>
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6533%252F20306533%252Finterior_rear_seats-1774702527002.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6533/20306533/interior_rear_seats-1774702527002.jpg saved to cache
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4b5d0>
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6533%252F20306533%252Finterior_front_seats-1774702476307.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6533/20306533/interior_front_seats-1774702476307.jpg saved to cache
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_passenger-1774701986417.jpg> (referer: None)
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb83950>
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_rear_passenger-1774701986417.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_passenger-1774701986417.jpg saved to cache
2026-03-29 20:25:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_driver-1774701908125.jpg> (referer: None)
2026-03-29 20:25:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_passenger-1774701998620.jpg> (referer: None)
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d3fa790>
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_front_driver-1774701908125.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_driver-1774701908125.jpg saved to cache
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22cb50>
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6533%252F20306533%252Fexterior_front_passenger-1774701998620.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_passenger-1774701998620.jpg saved to cache
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5c3d813-194e-5764-a42e-84268ee37012
2026-03-29 20:25:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5c3d813-194e-5764-a42e-84268ee37012, skipping ID generation
2026-03-29 20:25:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5c3d813-194e-5764-a42e-84268ee37012 with scrape type 1
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5c3d813-194e-5764-a42e-84268ee37012 sending to next pipeline
2026-03-29 20:25:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a5c3d813-194e-5764-a42e-84268ee37012, identifier: 20306533
2026-03-29 20:25:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a5c3d813-194e-5764-a42e-84268ee37012 with identifier: 20306533
2026-03-29 20:25:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a5c3d813-194e-5764-a42e-84268ee37012 with identifier: 20306533
2026-03-29 20:25:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a5c3d813-194e-5764-a42e-84268ee37012 with identifier: 20306533 to the API
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_passenger-1774701998620.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a5c3d813-194e-5764-a42e-84268ee37012',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG19 PXV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20306533',
'listing': 'auction',
'location': 'West Yorkshire Bradford',
'make': 'Audi',
'model': 'RS3',
'odometer': 80000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1540857,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_driver-1774701908125.jpg',
'Width': 3407},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1414237,
'Height': 2567,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_driver-1774701975169.jpg',
'Width': 3423},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1660734,
'Height': 2530,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_front_passenger-1774701998620.jpg',
'Width': 3373},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625886,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6533/20306533/exterior_rear_passenger-1774701986417.jpg',
'Width': 3554},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2702946,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6533/20306533/interior_front_seats-1774702476307.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2433847,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6533/20306533/interior_rear_seats-1774702527002.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2403947,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6533/20306533/20306533-interior_dashboard-modified-1774704397403.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2067459,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6533/20306533/instrument_cluster-1774702632881.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3927583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6533/20306533/interior_boot-1774702421755.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5c3d813-194e-5764-a42e-84268ee37012/a5c3d813-194e-5764-a42e-84268ee37012_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380631,
'Height': 2830,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6533/20306533/docs_service_history-1774702883327.jpg?ixlib=js-3.8.0&auto=format&s=d8d5603ba6894e22092621808bdc4c10',
'Width': 1910}],
'price': 25957,
'price_includes_vat': False,
'registration_date': '2019-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Audi RS 3 Sport ED TFSI Quat SA',
'transmission': 'automatic',
'trim': 'RS 3 Sport ED TFSI Quat SA',
'vin': 'WUAZZZ8V6KA903822',
'year': 2019}
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720306533%27 HTTP/1.1" 200 None
2026-03-29 20:25:18 [motorway.uk] INFO: Saving data for 20306533: {'created_time': 1774815918.651447, 'last_price_update_time': 1774815918.651476, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20306533') HTTP/1.1" 204 0
2026-03-29 20:25:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2457/3792457/interior_boot-1774708684757.jpg> (referer: None)
2026-03-29 20:25:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2457/3792457/instrument_cluster-1774707765326.jpg> (referer: None)
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb83850>
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2457%252F3792457%252Finterior_boot-1774708684757.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2457/3792457/interior_boot-1774708684757.jpg saved to cache
2026-03-29 20:25:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb81890>
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Finstrument_cluster-1774707765326.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/instrument_cluster-1774707765326.jpg saved to cache
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18349158.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2457/3792457/interior_dashboard-1774707778224.jpg> (referer: None)
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2457/3792457/interior_front_seats-1774707736535.jpg> (referer: None)
2026-03-29 20:25:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf1954b-6a0e-5731-a30c-ea0b006f594f with identifier: 18349158
2026-03-29 20:25:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf1954b-6a0e-5731-a30c-ea0b006f594f with scrape type 1
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Fexterior_front_driver-1774775378280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/exterior_front_driver-1774775378280.jpg not downloaded yet
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Fexterior_rear_driver-1774774894402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_driver-1774774894402.jpg not downloaded yet
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9158%252F18349158%252Fexterior_front_passenger-1773230050383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9158/18349158/exterior_front_passenger-1773230050383.jpg already downloaded
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Fexterior_rear_passenger-1774774919320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_passenger-1774774919320.jpg not downloaded yet
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e5c50>
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Finterior_dashboard-1774707778224.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/interior_dashboard-1774707778224.jpg saved to cache
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d269050>
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2457%252F3792457%252Finterior_front_seats-1774707736535.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2457/3792457/interior_front_seats-1774707736535.jpg saved to cache
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9158%252F18349158%252Finterior_front_seats-1773230859585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9158/18349158/interior_front_seats-1773230859585.jpg not downloaded yet
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_rear_passenger-1774707316990.jpg> (referer: None)
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9158%252F18349158%252Finterior_rear_seats-1773230886036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9158/18349158/interior_rear_seats-1773230886036.jpg not downloaded yet
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Finterior_dashboard-1774774851954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/interior_dashboard-1774774851954.jpg not downloaded yet
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9158%252F18349158%252Finstrument_cluster-1773230915287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9158/18349158/instrument_cluster-1773230915287.jpg already downloaded
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Finterior_boot-1774775333285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/interior_boot-1774775333285.jpg not downloaded yet
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9158%252F18349158%252Fdocs_service_history-1773231627636.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc92c5bc1f9bea6d47cd450bdace963df%27 HTTP/1.1" 200 None
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9158/18349158/docs_service_history-1773231627636.jpg?ixlib=js-3.8.0&auto=format&s=c92c5bc1f9bea6d47cd450bdace963df not downloaded yet
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2457/3792457/exterior_rear_driver-1774708842553.jpg> (referer: None)
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_passenger-1774707315580.jpg> (referer: None)
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb0890>
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Fexterior_rear_passenger-1774707316990.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_rear_passenger-1774707316990.jpg saved to cache
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5ecd0>
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2457%252F3792457%252Fexterior_rear_driver-1774708842553.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2457/3792457/exterior_rear_driver-1774708842553.jpg saved to cache
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca64f90>
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Fexterior_front_passenger-1774707315580.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_passenger-1774707315580.jpg saved to cache
2026-03-29 20:25:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9158/18349158/interior_boot-1774775333285.jpg> (referer: None)
2026-03-29 20:25:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9158/18349158/interior_front_seats-1773230859585.jpg> (referer: None)
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadf090>
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Finterior_boot-1774775333285.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/interior_boot-1774775333285.jpg saved to cache
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:11 12:06:43\x00'
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb1e90>
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9158%252F18349158%252Finterior_front_seats-1773230859585.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9158/18349158/interior_front_seats-1773230859585.jpg saved to cache
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9158/18349158/interior_dashboard-1774774851954.jpg> (referer: None)
2026-03-29 20:25:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9158/18349158/docs_service_history-1773231627636.jpg?ixlib=js-3.8.0&auto=format&s=c92c5bc1f9bea6d47cd450bdace963df> (referer: None)
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a2010>
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Finterior_dashboard-1774774851954.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/interior_dashboard-1774774851954.jpg saved to cache
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:11 12:20:22\x00'
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb0550>
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9158%252F18349158%252Fdocs_service_history-1773231627636.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc92c5bc1f9bea6d47cd450bdace963df') HTTP/1.1" 204 0
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9158/18349158/docs_service_history-1773231627636.jpg?ixlib=js-3.8.0&auto=format&s=c92c5bc1f9bea6d47cd450bdace963df saved to cache
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_passenger-1774774919320.jpg> (referer: None)
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d01ee50>
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Fexterior_rear_passenger-1774774919320.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_passenger-1774774919320.jpg saved to cache
2026-03-29 20:25:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_driver-1774774894402.jpg> (referer: None)
2026-03-29 20:25:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9158/18349158/exterior_front_driver-1774775378280.jpg> (referer: None)
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec922d0>
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Fexterior_rear_driver-1774774894402.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_driver-1774774894402.jpg saved to cache
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec90d90>
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9158%252F18349158%252Fexterior_front_driver-1774775378280.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9158/18349158/exterior_front_driver-1774775378280.jpg saved to cache
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_driver-1774708831399.jpg> (referer: None)
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2ed90>
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2457%252F3792457%252Fexterior_front_driver-1774708831399.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_driver-1774708831399.jpg saved to cache
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798820ef-ed11-53e2-838e-8058f43aa181
2026-03-29 20:25:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798820ef-ed11-53e2-838e-8058f43aa181, skipping ID generation
2026-03-29 20:25:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798820ef-ed11-53e2-838e-8058f43aa181 with scrape type 1
2026-03-29 20:25:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798820ef-ed11-53e2-838e-8058f43aa181 sending to next pipeline
2026-03-29 20:25:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 798820ef-ed11-53e2-838e-8058f43aa181, identifier: 3792457
2026-03-29 20:25:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 798820ef-ed11-53e2-838e-8058f43aa181 with identifier: 3792457
2026-03-29 20:25:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 798820ef-ed11-53e2-838e-8058f43aa181 with identifier: 3792457
2026-03-29 20:25:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 798820ef-ed11-53e2-838e-8058f43aa181 with identifier: 3792457 to the API
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_driver-1774708831399.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '798820ef-ed11-53e2-838e-8058f43aa181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YN67 VKO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3792457',
'listing': 'auction',
'location': 'Halton Widnes',
'make': 'Jaguar',
'model': 'F-TYPE',
'odometer': 79951,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701193,
'Height': 2141,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_driver-1774708831399.jpg',
'Width': 2854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1536896,
'Height': 2558,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2457/3792457/exterior_rear_driver-1774708842553.jpg',
'Width': 3411},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350602,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_front_passenger-1774707315580.jpg',
'Width': 3711},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1188878,
'Height': 2632,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2457/3792457/exterior_rear_passenger-1774707316990.jpg',
'Width': 3509},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1357262,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2457/3792457/interior_front_seats-1774707736535.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1490606,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2457/3792457/interior_dashboard-1774707778224.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238637,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2457/3792457/instrument_cluster-1774707765326.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1014092,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2457/3792457/interior_boot-1774708684757.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1410091,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2457/3792457/docs_service_history-1774708752817.jpg?ixlib=js-3.8.0&auto=format&s=e243fa8eb5c2f445f1c7e98ead254b63',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798820ef-ed11-53e2-838e-8058f43aa181/798820ef-ed11-53e2-838e-8058f43aa181_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1026546,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2457/3792457/damage_dents-1774707350548.jpg',
'Width': 3840}],
'price': 20002,
'price_includes_vat': False,
'registration_date': '2017-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-TYPE V6 R-DYNAMIC Auto',
'transmission': 'automatic',
'trim': 'V6 R-DYNAMIC Auto',
'vin': 'SAJDB1AV7JCK53149',
'year': 2017}
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273792457%27 HTTP/1.1" 200 None
2026-03-29 20:25:22 [motorway.uk] INFO: Saving data for 3792457: {'created_time': 1774815922.017452, 'last_price_update_time': 1774815922.017463, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3792457') HTTP/1.1" 204 0
2026-03-29 20:25:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9158/18349158/interior_rear_seats-1773230886036.jpg> (referer: None)
2026-03-29 20:25:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_front_passenger-1774702762523.jpg> (referer: None)
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S911B\x00'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S911BXXS8EZA1\x00'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:22 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:11 12:08:00\x00'
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebe9850>
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9158%252F18349158%252Finterior_rear_seats-1773230886036.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9158/18349158/interior_rear_seats-1773230886036.jpg saved to cache
2026-03-29 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcf1954b-6a0e-5731-a30c-ea0b006f594f
2026-03-29 20:25:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcf1954b-6a0e-5731-a30c-ea0b006f594f, skipping ID generation
2026-03-29 20:25:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf1954b-6a0e-5731-a30c-ea0b006f594f with scrape type 1
2026-03-29 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcf1954b-6a0e-5731-a30c-ea0b006f594f sending to next pipeline
2026-03-29 20:25:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bcf1954b-6a0e-5731-a30c-ea0b006f594f, identifier: 18349158
2026-03-29 20:25:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bcf1954b-6a0e-5731-a30c-ea0b006f594f with identifier: 18349158
2026-03-29 20:25:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bcf1954b-6a0e-5731-a30c-ea0b006f594f with identifier: 18349158
2026-03-29 20:25:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bcf1954b-6a0e-5731-a30c-ea0b006f594f with identifier: 18349158 to the API
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9158/18349158/interior_rear_seats-1773230886036.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bcf1954b-6a0e-5731-a30c-ea0b006f594f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF17 OVW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18349158',
'listing': 'auction',
'location': 'Derbyshire Chesterfield',
'make': 'Audi',
'model': 'S5',
'odometer': 66073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1972608,
'Height': 2160,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9158/18349158/exterior_front_driver-1774775378280.jpg',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1979866,
'Height': 2234,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_driver-1774774894402.jpg',
'Width': 2979},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1157116,
'Height': 2177,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9158/18349158/exterior_front_passenger-1773230050383.jpg',
'Width': 2902},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1126308,
'Height': 1887,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9158/18349158/exterior_rear_passenger-1774774919320.jpg',
'Width': 2516},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7127918,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9158/18349158/interior_front_seats-1773230859585.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6830262,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9158/18349158/interior_rear_seats-1773230886036.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1812307,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9158/18349158/interior_dashboard-1774774851954.jpg',
'Width': 5440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5743732,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9158/18349158/instrument_cluster-1773230915287.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484730,
'Height': 2295,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9158/18349158/interior_boot-1774775333285.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf1954b-6a0e-5731-a30c-ea0b006f594f/bcf1954b-6a0e-5731-a30c-ea0b006f594f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6398298,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9158/18349158/docs_service_history-1773231627636.jpg?ixlib=js-3.8.0&auto=format&s=c92c5bc1f9bea6d47cd450bdace963df',
'Width': 4080}],
'price': 17309,
'price_includes_vat': False,
'registration_date': '2017-06-21',
'seats_number': None,
'seller_name': None,
'title': 'Audi S5 TFSI Quattro Auto',
'transmission': 'automatic',
'trim': 'TFSI Quattro Auto',
'vin': 'WAUZZZF59HA037989',
'year': 2017}
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718349158%27 HTTP/1.1" 200 None
2026-03-29 20:25:22 [motorway.uk] INFO: Saving data for 18349158: {'created_time': 1774815922.869798, 'last_price_update_time': 1774815922.869808, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18349158') HTTP/1.1" 204 0
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc02590>
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5341%252F13105341%252Fexterior_front_passenger-1774702762523.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_front_passenger-1774702762523.jpg saved to cache
2026-03-29 20:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:25:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4589/15364589/instrument_cluster-1774706691775.jpeg> (referer: None)
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31dc90>
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Finstrument_cluster-1774706691775.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/instrument_cluster-1774706691775.jpeg saved to cache
2026-03-29 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5341/13105341/exterior_front_driver-1774705367395.jpg> (referer: None)
2026-03-29 20:25:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4589/15364589/15364589-interior_dashboard-modified-1774707860158.jpeg> (referer: None)
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadcb10>
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5341%252F13105341%252Fexterior_front_driver-1774705367395.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5341/13105341/exterior_front_driver-1774705367395.jpg saved to cache
2026-03-29 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d
2026-03-29 20:25:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 144db9b4-bd33-5bf7-9e64-d5dfc774490d, skipping ID generation
2026-03-29 20:25:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d with scrape type 1
2026-03-29 20:25:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 144db9b4-bd33-5bf7-9e64-d5dfc774490d sending to next pipeline
2026-03-29 20:25:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 144db9b4-bd33-5bf7-9e64-d5dfc774490d, identifier: 13105341
2026-03-29 20:25:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 144db9b4-bd33-5bf7-9e64-d5dfc774490d with identifier: 13105341
2026-03-29 20:25:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 144db9b4-bd33-5bf7-9e64-d5dfc774490d with identifier: 13105341
2026-03-29 20:25:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 144db9b4-bd33-5bf7-9e64-d5dfc774490d with identifier: 13105341 to the API
2026-03-29 20:25:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5341/13105341/exterior_front_driver-1774705367395.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '0.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '144db9b4-bd33-5bf7-9e64-d5dfc774490d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FP14 OYS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13105341',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'Renault',
'model': 'Other Renault',
'odometer': 55186,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977769,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5341/13105341/exterior_front_driver-1774705367395.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1188338,
'Height': 2303,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_driver-1774702759581.jpg',
'Width': 3070},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1442233,
'Height': 2336,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_front_passenger-1774702762523.jpg',
'Width': 3115},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1613188,
'Height': 2428,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5341/13105341/exterior_rear_passenger-1774702976058.jpg',
'Width': 3237},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3871221,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5341/13105341/interior_front_seats-1774703693608.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4138615,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5341/13105341/interior_rear_seats-1774703687438.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2872808,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5341/13105341/interior_dashboard-1774703698536.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2738857,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5341/13105341/instrument_cluster-1774703709195.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3789993,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5341/13105341/interior_boot-1774703691664.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_144db9b4-bd33-5bf7-9e64-d5dfc774490d/144db9b4-bd33-5bf7-9e64-d5dfc774490d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757716,
'Height': 2464,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5341/13105341/docs_service_history-1774703848613.jpg?ixlib=js-3.8.0&auto=format&s=b98bd83077dc801fe1ed2ba937985c9b',
'Width': 3280}],
'price': 4046,
'price_includes_vat': False,
'registration_date': '2014-05-13',
'seats_number': None,
'seller_name': None,
'title': 'Renault CAPTURD-QUE S M-NAV NRG Tcesss',
'transmission': 'manual',
'trim': 'CAPTURD-QUE S M-NAV NRG Tcesss',
'vin': 'VF12RFA1H50285134',
'year': 2014}
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713105341%27 HTTP/1.1" 200 None
2026-03-29 20:25:24 [motorway.uk] INFO: Saving data for 13105341: {'created_time': 1774815924.190566, 'last_price_update_time': 1774815924.190581, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13105341') HTTP/1.1" 204 0
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03db90>
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4589%252F15364589%252F15364589-interior_dashboard-modified-1774707860158.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4589/15364589/15364589-interior_dashboard-modified-1774707860158.jpeg saved to cache
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4589/15364589/interior_front_seats-1774706710403.jpeg> (referer: None)
2026-03-29 20:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4589/15364589/interior_rear_seats-1774706827994.jpeg> (referer: None)
2026-03-29 20:25:24 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:25:24 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:25:24 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+\x83h\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xc6\xd2\x00+x\xe6\x00\x00\x00\x00'
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf6690>
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4589%252F15364589%252Finterior_front_seats-1774706710403.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4589/15364589/interior_front_seats-1774706710403.jpeg saved to cache
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:24 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:25:24 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:25:24 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(8C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02-5\x00(-\xc1\x00\x00\x00\x00'
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd7990>
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4589%252F15364589%252Finterior_rear_seats-1774706827994.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4589/15364589/interior_rear_seats-1774706827994.jpeg saved to cache
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_passenger-1774706452009.jpeg> (referer: None)
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadc050>
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_rear_passenger-1774706452009.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_passenger-1774706452009.jpeg saved to cache
2026-03-29 20:25:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_passenger-1774706441826.jpeg> (referer: None)
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc01910>
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_front_passenger-1774706441826.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_passenger-1774706441826.jpeg saved to cache
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_driver-1774706466312.jpeg> (referer: None)
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ef350>
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_rear_driver-1774706466312.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_driver-1774706466312.jpeg saved to cache
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_driver-1774706418290.jpeg> (referer: None)
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebeb7d0>
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4589%252F15364589%252Fexterior_front_driver-1774706418290.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_driver-1774706418290.jpeg saved to cache
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d67acae-ad8f-50af-be54-2024b52137f3
2026-03-29 20:25:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d67acae-ad8f-50af-be54-2024b52137f3, skipping ID generation
2026-03-29 20:25:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d67acae-ad8f-50af-be54-2024b52137f3 with scrape type 1
2026-03-29 20:25:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d67acae-ad8f-50af-be54-2024b52137f3 sending to next pipeline
2026-03-29 20:25:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9d67acae-ad8f-50af-be54-2024b52137f3, identifier: 15364589
2026-03-29 20:25:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9d67acae-ad8f-50af-be54-2024b52137f3 with identifier: 15364589
2026-03-29 20:25:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9d67acae-ad8f-50af-be54-2024b52137f3 with identifier: 15364589
2026-03-29 20:25:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9d67acae-ad8f-50af-be54-2024b52137f3 with identifier: 15364589 to the API
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_driver-1774706418290.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9d67acae-ad8f-50af-be54-2024b52137f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'H21 RBB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15364589',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 41926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1423373,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_driver-1774706418290.jpeg',
'Width': 3244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1495858,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_driver-1774706466312.jpeg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1794450,
'Height': 2745,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_front_passenger-1774706441826.jpeg',
'Width': 3660},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1277958,
'Height': 2322,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4589/15364589/exterior_rear_passenger-1774706452009.jpeg',
'Width': 3096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3033658,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4589/15364589/interior_front_seats-1774706710403.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2778488,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4589/15364589/interior_rear_seats-1774706827994.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326861,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4589/15364589/15364589-interior_dashboard-modified-1774707860158.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1180022,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4589/15364589/instrument_cluster-1774706691775.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3565983,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4589/15364589/interior_boot-1774706657392.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d67acae-ad8f-50af-be54-2024b52137f3/9d67acae-ad8f-50af-be54-2024b52137f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623929,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4589/15364589/docs_service_history-1774707367297.jpeg?ixlib=js-3.8.0&auto=format&s=855c09a61825b3b8558ca947c51ea0d8',
'Width': 4032}],
'price': 15788,
'price_includes_vat': False,
'registration_date': '2019-01-05',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 250 AMG Line Premium + A',
'transmission': 'automatic',
'trim': 'A 250 AMG Line Premium + A',
'vin': 'WDD1770462V016605',
'year': 2019}
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715364589%27 HTTP/1.1" 200 None
2026-03-29 20:25:26 [motorway.uk] INFO: Saving data for 15364589: {'created_time': 1774815926.087228, 'last_price_update_time': 1774815926.087242, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15364589') HTTP/1.1" 204 0
2026-03-29 20:25:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_passenger-1774698255611.jpeg> (referer: None)
2026-03-29 20:25:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf77d0>
2026-03-29 20:25:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4729%252F19564729%252Fexterior_front_passenger-1774698255611.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_passenger-1774698255611.jpeg saved to cache
2026-03-29 20:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6
2026-03-29 20:25:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6, skipping ID generation
2026-03-29 20:25:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 with scrape type 1
2026-03-29 20:25:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 sending to next pipeline
2026-03-29 20:25:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6, identifier: 19564729
2026-03-29 20:25:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 with identifier: 19564729
2026-03-29 20:25:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 with identifier: 19564729
2026-03-29 20:25:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b480c28-5dfa-5f25-a265-d3ff16e8b7d6 with identifier: 19564729 to the API
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_passenger-1774698255611.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9b480c28-5dfa-5f25-a265-d3ff16e8b7d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NU70 GDO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19564729',
'listing': 'auction',
'location': 'Norfolk Wisbech',
'make': 'Renault',
'model': 'Clio',
'odometer': 80500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5225073,
'Height': 5058,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_driver-1774698247180.jpeg',
'Width': 6744},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5938063,
'Height': 5344,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_rear_driver-1774698286101.jpeg',
'Width': 7125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5182614,
'Height': 5098,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4729/19564729/exterior_front_passenger-1774698255611.jpeg',
'Width': 6797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10043399,
'Height': 6029,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4729/19564729/19564729-exterior_rear_passenger-modified-1774702841495.jpeg',
'Width': 8039},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12686716,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/4729/19564729/interior_front_seats-1774698580232.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 11323180,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/4729/19564729/interior_rear_seats-1774698743216.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6722533,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4729/19564729/19564729-interior_dashboard-modified-1774700287912.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8540121,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4729/19564729/instrument_cluster-1774698755230.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 15207230,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/4729/19564729/interior_boot-1774698799302.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b480c28-5dfa-5f25-a265-d3ff16e8b7d6/9b480c28-5dfa-5f25-a265-d3ff16e8b7d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1417031,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4729/19564729/docs_service_history-1774699547930.jpeg?ixlib=js-3.8.0&auto=format&s=35475421ad3febf821db638d59cece9f',
'Width': 4032}],
'price': 5766,
'price_includes_vat': False,
'registration_date': '2020-09-14',
'seats_number': None,
'seller_name': None,
'title': 'Renault Clio Iconic Blue DCI',
'transmission': 'manual',
'trim': 'Iconic Blue DCI',
'vin': 'VF1RJA00265550739',
'year': 2020}
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719564729%27 HTTP/1.1" 200 None
2026-03-29 20:25:26 [motorway.uk] INFO: Saving data for 19564729: {'created_time': 1774815926.924998, 'last_price_update_time': 1774815926.925009, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19564729') HTTP/1.1" 204 0
2026-03-29 20:25:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.111(s), this was the 1st time calling it.
2026-03-29 20:25:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.936328080223961 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20028099.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19dc3fd4-b821-5f40-9da1-e35214e14ff1 with identifier: 20028099
2026-03-29 20:25:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1 with scrape type 1
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_front_driver-1774618852016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_driver-1774618852016.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_rear_driver-1774618654841.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_driver-1774618654841.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_front_passenger-1774618710747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_passenger-1774618710747.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_rear_passenger-1774618677970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_passenger-1774618677970.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20028099%252Finterior_front_seats-1774619870786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20028099/interior_front_seats-1774619870786.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20028099%252Finterior_rear_seats-1774619859056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20028099/interior_rear_seats-1774619859056.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Finterior_dashboard-1774619862378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/interior_dashboard-1774619862378.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8099%252F20028099%252Finstrument_cluster-1774620907115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8099/20028099/instrument_cluster-1774620907115.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20028099%252Finterior_boot-1774619920439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20028099/interior_boot-1774619920439.jpg not downloaded yet
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8099%252F20028099%252Fdocs_service_history-1774775693482.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dacfe5ad9d0cc86db68aa50a8b4a653b8%27 HTTP/1.1" 200 None
2026-03-29 20:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8099/20028099/docs_service_history-1774775693482.jpg?ixlib=js-3.8.0&auto=format&s=acfe5ad9d0cc86db68aa50a8b4a653b8 not downloaded yet
2026-03-29 20:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485756.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74102b82-6c28-50fe-8f40-22c0c5bcceee with identifier: 20485756
2026-03-29 20:25:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74102b82-6c28-50fe-8f40-22c0c5bcceee with scrape type 1
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_front_driver-1774695804999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_driver-1774695804999.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_rear_driver-1774695801960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_driver-1774695801960.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_front_passenger-1774695829036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_passenger-1774695829036.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_rear_passenger-1774695806153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_passenger-1774695806153.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5756%252F20485756%252Finterior_front_seats-1774696213732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5756/20485756/interior_front_seats-1774696213732.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5756%252F20485756%252Finterior_rear_seats-1774696215478.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5756/20485756/interior_rear_seats-1774696215478.jpg not downloaded yet
2026-03-29 20:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8099/20028099/docs_service_history-1774775693482.jpg?ixlib=js-3.8.0&auto=format&s=acfe5ad9d0cc86db68aa50a8b4a653b8> (referer: None)
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Finterior_dashboard-1774696231331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/interior_dashboard-1774696231331.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5756%252F20485756%252Finstrument_cluster-1774698946324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5756/20485756/instrument_cluster-1774698946324.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5756%252F20485756%252Finterior_boot-1774696217107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5756/20485756/interior_boot-1774696217107.jpg not downloaded yet
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5756%252F20485756%252Fdocs_service_history-1774696408097.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf46bfcf2a7ef3fab4bcb1c49e596dcc%27 HTTP/1.1" 200 None
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5756/20485756/docs_service_history-1774696408097.jpg?ixlib=js-3.8.0&auto=format&s=bf46bfcf2a7ef3fab4bcb1c49e596dcc not downloaded yet
2026-03-29 20:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t$'
2026-03-29 20:25:30 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:25:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5cd10>
2026-03-29 20:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8099%252F20028099%252Fdocs_service_history-1774775693482.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dacfe5ad9d0cc86db68aa50a8b4a653b8') HTTP/1.1" 204 0
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8099/20028099/docs_service_history-1774775693482.jpg?ixlib=js-3.8.0&auto=format&s=acfe5ad9d0cc86db68aa50a8b4a653b8 saved to cache
2026-03-29 20:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5756/20485756/interior_front_seats-1774696213732.jpg> (referer: None)
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadeb90>
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5756%252F20485756%252Finterior_front_seats-1774696213732.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5756/20485756/interior_front_seats-1774696213732.jpg saved to cache
2026-03-29 20:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5756/20485756/docs_service_history-1774696408097.jpg?ixlib=js-3.8.0&auto=format&s=bf46bfcf2a7ef3fab4bcb1c49e596dcc> (referer: None)
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecd7d0>
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5756%252F20485756%252Fdocs_service_history-1774696408097.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf46bfcf2a7ef3fab4bcb1c49e596dcc') HTTP/1.1" 204 0
2026-03-29 20:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5756/20485756/docs_service_history-1774696408097.jpg?ixlib=js-3.8.0&auto=format&s=bf46bfcf2a7ef3fab4bcb1c49e596dcc saved to cache
2026-03-29 20:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5756/20485756/interior_boot-1774696217107.jpg> (referer: None)
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce58410>
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5756%252F20485756%252Finterior_boot-1774696217107.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5756/20485756/interior_boot-1774696217107.jpg saved to cache
2026-03-29 20:25:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:25:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=864&page=24&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:31 [motorway.uk] INFO: Found listing with ID: 1329664
2026-03-29 20:25:31 [motorway.uk] INFO: Found listing with ID: 20409002
2026-03-29 20:25:31 [motorway.uk] INFO: Found listing with ID: 18827226
2026-03-29 20:25:31 [motorway.uk] INFO: Found listing with ID: 20436077
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436077%27 HTTP/1.1" 200 None
2026-03-29 20:25:31 [motorway.uk] INFO: Scrape type for 20436077: 1
2026-03-29 20:25:31 [motorway.uk] INFO: Found listing with ID: 16052794
2026-03-29 20:25:31 [motorway.uk] INFO: Found listing with ID: 20401398
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401398%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 20401398: 1
2026-03-29 20:25:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5756/20485756/instrument_cluster-1774698946324.jpg> (referer: None)
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20375710
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720375710%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 20375710: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 17939747
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20202196
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 18800703
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 12120509
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 14548428
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20386514
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386514%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 20386514: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 17979492
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20435734
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 19226483
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20265624
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 7585646
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277585646%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 7585646: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 19995676
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719995676%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 19995676: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 16512497
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20498788
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 6438177
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276438177%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 6438177: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20309766
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720309766%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 20309766: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20454787
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20456993
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20486739
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20130808
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720130808%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 20130808: 2
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9a1510>
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5756%252F20485756%252Finstrument_cluster-1774698946324.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5756/20485756/instrument_cluster-1774698946324.jpg saved to cache
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20423862
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20283454
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 10973365
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20392215
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20496032
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 19667593
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 13151440
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 19970268
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719970268%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [motorway.uk] INFO: Scrape type for 19970268: 1
2026-03-29 20:25:32 [motorway.uk] INFO: Found listing with ID: 20240702
2026-03-29 20:25:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5756/20485756/interior_dashboard-1774696231331.jpg> (referer: None)
2026-03-29 20:25:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19812836.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec38690>
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Finterior_dashboard-1774696231331.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/interior_dashboard-1774696231331.jpg saved to cache
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:25:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74d2bd9a-e1f3-5890-823a-bebd0f011c19 with identifier: 19812836
2026-03-29 20:25:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19 with scrape type 1
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_front_driver-1774704006053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_driver-1774704006053.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_rear_driver-1774704011298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_driver-1774704011298.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_front_passenger-1774704057168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_passenger-1774704057168.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_rear_passenger-1774704025387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_passenger-1774704025387.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2836%252F19812836%252Finterior_front_seats-1774704287232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2836/19812836/interior_front_seats-1774704287232.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2836%252F19812836%252Finterior_rear_seats-1774704299972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2836/19812836/interior_rear_seats-1774704299972.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2836%252F19812836%252Finterior_dashboard-1774708656665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2836/19812836/interior_dashboard-1774708656665.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Finstrument_cluster-1774704392088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/instrument_cluster-1774704392088.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2836%252F19812836%252Finterior_boot-1774704381892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2836/19812836/interior_boot-1774704381892.jpg not downloaded yet
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2836%252F19812836%252Fdocs_service_history-1774704641431.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb669d385c3916f342e65b2bf394be37%27 HTTP/1.1" 200 None
2026-03-29 20:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2836/19812836/docs_service_history-1774704641431.jpg?ixlib=js-3.8.0&auto=format&s=cb669d385c3916f342e65b2bf394be37 not downloaded yet
2026-03-29 20:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/1379253.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f with identifier: 1379253
2026-03-29 20:25:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f with scrape type 1
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Fexterior_front_driver-1774696910754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/exterior_front_driver-1774696910754.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9253%252F1379253%252Fexterior_rear_driver-1774679721206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_rear_driver-1774679721206.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9253%252F1379253%252Fexterior_front_passenger-1774679737955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_front_passenger-1774679737955.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Fexterior_rear_passenger-1774696929609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/exterior_rear_passenger-1774696929609.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Finterior_front_seats-1774696942443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/interior_front_seats-1774696942443.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9253%252F1379253%252Finterior_rear_seats-1774680183621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9253/1379253/interior_rear_seats-1774680183621.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Finterior_dashboard-1774696892962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/interior_dashboard-1774696892962.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9253%252F1379253%252Finstrument_cluster-1774680170872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9253/1379253/instrument_cluster-1774680170872.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9253%252F1379253%252Finterior_boot-1774680126228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9253/1379253/interior_boot-1774680126228.jpg not downloaded yet
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9253%252F1379253%252Fdocs_service_history-1774680291484.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda20cd3feda024b061f029d6bc28f657%27 HTTP/1.1" 200 None
2026-03-29 20:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9253/1379253/docs_service_history-1774680291484.jpg?ixlib=js-3.8.0&auto=format&s=da20cd3feda024b061f029d6bc28f657 not downloaded yet
2026-03-29 20:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2836/19812836/docs_service_history-1774704641431.jpg?ixlib=js-3.8.0&auto=format&s=cb669d385c3916f342e65b2bf394be37> (referer: None)
2026-03-29 20:25:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cdd50>
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2836%252F19812836%252Fdocs_service_history-1774704641431.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb669d385c3916f342e65b2bf394be37') HTTP/1.1" 204 0
2026-03-29 20:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2836/19812836/docs_service_history-1774704641431.jpg?ixlib=js-3.8.0&auto=format&s=cb669d385c3916f342e65b2bf394be37 saved to cache
2026-03-29 20:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9253/1379253/docs_service_history-1774680291484.jpg?ixlib=js-3.8.0&auto=format&s=da20cd3feda024b061f029d6bc28f657> (referer: None)
2026-03-29 20:25:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e997310>
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9253%252F1379253%252Fdocs_service_history-1774680291484.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda20cd3feda024b061f029d6bc28f657') HTTP/1.1" 204 0
2026-03-29 20:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9253/1379253/docs_service_history-1774680291484.jpg?ixlib=js-3.8.0&auto=format&s=da20cd3feda024b061f029d6bc28f657 saved to cache
2026-03-29 20:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5678750.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0d996b3-3e0a-57e5-8712-d65396fcf68b with identifier: 5678750
2026-03-29 20:25:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d996b3-3e0a-57e5-8712-d65396fcf68b with scrape type 1
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_front_driver-1774698307886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_driver-1774698307886.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_rear_driver-1774698324498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_driver-1774698324498.jpg not downloaded yet
2026-03-29 20:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9253/1379253/interior_boot-1774680126228.jpg> (referer: None)
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_front_passenger-1774698361491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_passenger-1774698361491.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_rear_passenger-1774698344589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_passenger-1774698344589.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8750%252F5678750%252Finterior_front_seats-1774699042784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8750/5678750/interior_front_seats-1774699042784.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8750%252F5678750%252Finterior_rear_seats-1774698960143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8750/5678750/interior_rear_seats-1774698960143.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Finterior_dashboard-1774699000645.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/interior_dashboard-1774699000645.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Finstrument_cluster-1774699028035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/instrument_cluster-1774699028035.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8750%252F5678750%252Finterior_boot-1774699002567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8750/5678750/interior_boot-1774699002567.jpg not downloaded yet
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13c310>
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9253%252F1379253%252Finterior_boot-1774680126228.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9253/1379253/interior_boot-1774680126228.jpg saved to cache
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8750%252F5678750%252Fdocs_service_history-1774699364196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9aa8791033dbd835d206efca70a3eee9%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8750/5678750/docs_service_history-1774699364196.jpg?ixlib=js-3.8.0&auto=format&s=9aa8791033dbd835d206efca70a3eee9 not downloaded yet
2026-03-29 20:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_driver-1774698324498.jpg> (referer: None)
2026-03-29 20:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9253/1379253/instrument_cluster-1774680170872.jpg> (referer: None)
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd84d0>
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_rear_driver-1774698324498.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_driver-1774698324498.jpg saved to cache
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20129049.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d023fd0>
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9253%252F1379253%252Finstrument_cluster-1774680170872.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9253/1379253/instrument_cluster-1774680170872.jpg saved to cache
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b4d7692-9d1e-52a7-914a-d1c89684ed1c with identifier: 20129049
2026-03-29 20:25:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c with scrape type 1
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_front_driver-1774773453364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_driver-1774773453364.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_rear_driver-1774773481885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_driver-1774773481885.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_front_passenger-1774773552708.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_passenger-1774773552708.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_rear_passenger-1774773591778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_passenger-1774773591778.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9049%252F20129049%252Finterior_front_seats-1774774413399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9049/20129049/interior_front_seats-1774774413399.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9049%252F20129049%252Finterior_rear_seats-1774773972854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9049/20129049/interior_rear_seats-1774773972854.jpg not downloaded yet
2026-03-29 20:25:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8750/5678750/docs_service_history-1774699364196.jpg?ixlib=js-3.8.0&auto=format&s=9aa8791033dbd835d206efca70a3eee9> (referer: None)
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Finterior_dashboard-1774773943444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/interior_dashboard-1774773943444.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Finstrument_cluster-1774774310168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/instrument_cluster-1774774310168.jpg not downloaded yet
2026-03-29 20:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9049%252F20129049%252Finterior_boot-1774773908332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9049/20129049/interior_boot-1774773908332.jpg not downloaded yet
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9049%252F20129049%252Fdocs_service_history-1774774471244.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6b16e8b73dac927c60a3ff141d943ff2%27 HTTP/1.1" 200 None
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9049/20129049/docs_service_history-1774774471244.jpg?ixlib=js-3.8.0&auto=format&s=6b16e8b73dac927c60a3ff141d943ff2 not downloaded yet
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c257390>
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8750%252F5678750%252Fdocs_service_history-1774699364196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9aa8791033dbd835d206efca70a3eee9') HTTP/1.1" 204 0
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8750/5678750/docs_service_history-1774699364196.jpg?ixlib=js-3.8.0&auto=format&s=9aa8791033dbd835d206efca70a3eee9 saved to cache
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8750/5678750/interior_boot-1774699002567.jpg> (referer: None)
2026-03-29 20:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8750/5678750/instrument_cluster-1774699028035.jpg> (referer: None)
2026-03-29 20:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9049/20129049/interior_rear_seats-1774773972854.jpg> (referer: None)
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce6afd0>
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8750%252F5678750%252Finterior_boot-1774699002567.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8750/5678750/interior_boot-1774699002567.jpg saved to cache
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf4210>
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Finstrument_cluster-1774699028035.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/instrument_cluster-1774699028035.jpg saved to cache
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1b950>
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9049%252F20129049%252Finterior_rear_seats-1774773972854.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9049/20129049/interior_rear_seats-1774773972854.jpg saved to cache
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18114859.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9049/20129049/docs_service_history-1774774471244.jpg?ixlib=js-3.8.0&auto=format&s=6b16e8b73dac927c60a3ff141d943ff2> (referer: None)
2026-03-29 20:25:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d4795af-5f7a-506a-b0cc-82e1455731d7 with identifier: 18114859
2026-03-29 20:25:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d4795af-5f7a-506a-b0cc-82e1455731d7 with scrape type 1
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_front_driver-1774778089337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_driver-1774778089337.jpg not downloaded yet
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_rear_driver-1774778192148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_driver-1774778192148.jpg not downloaded yet
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_front_passenger-1774778114989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_passenger-1774778114989.jpg not downloaded yet
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8cf10>
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9049%252F20129049%252Fdocs_service_history-1774774471244.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6b16e8b73dac927c60a3ff141d943ff2') HTTP/1.1" 204 0
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9049/20129049/docs_service_history-1774774471244.jpg?ixlib=js-3.8.0&auto=format&s=6b16e8b73dac927c60a3ff141d943ff2 saved to cache
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_rear_passenger-1774778190409.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_passenger-1774778190409.jpg not downloaded yet
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4859%252F18114859%252Finterior_front_seats-1774778309900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4859/18114859/interior_front_seats-1774778309900.jpg not downloaded yet
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4859%252F18114859%252Finterior_rear_seats-1774778343383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4859/18114859/interior_rear_seats-1774778343383.jpg not downloaded yet
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Finterior_dashboard-1774778545678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/interior_dashboard-1774778545678.jpg not downloaded yet
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4859%252F18114859%252Finterior_boot-1774778433903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4859/18114859/interior_boot-1774778433903.jpg not downloaded yet
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4859%252F18114859%252Fdocs_service_history-1769421276941.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6f289c143af28e74e88b2c0b6d71e344%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421276941.jpg?ixlib=js-3.8.0&auto=format&s=6f289c143af28e74e88b2c0b6d71e344 not downloaded yet
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4859%252F18114859%252Fdocs_service_history-1769421294381.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df82de2a1c5b15f6fa7b0254c769c532e%27 HTTP/1.1" 200 None
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421294381.jpg?ixlib=js-3.8.0&auto=format&s=f82de2a1c5b15f6fa7b0254c769c532e not downloaded yet
2026-03-29 20:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9049/20129049/interior_dashboard-1774773943444.jpg> (referer: None)
2026-03-29 20:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9049/20129049/interior_front_seats-1774774413399.jpg> (referer: None)
2026-03-29 20:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9049/20129049/interior_boot-1774773908332.jpg> (referer: None)
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2f250>
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Finterior_dashboard-1774773943444.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/interior_dashboard-1774773943444.jpg saved to cache
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec17090>
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9049%252F20129049%252Finterior_front_seats-1774774413399.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9049/20129049/interior_front_seats-1774774413399.jpg saved to cache
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22b950>
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9049%252F20129049%252Finterior_boot-1774773908332.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9049/20129049/interior_boot-1774773908332.jpg saved to cache
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9049/20129049/instrument_cluster-1774774310168.jpg> (referer: None)
2026-03-29 20:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421294381.jpg?ixlib=js-3.8.0&auto=format&s=f82de2a1c5b15f6fa7b0254c769c532e> (referer: None)
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf4090>
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Finstrument_cluster-1774774310168.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/instrument_cluster-1774774310168.jpg saved to cache
2026-03-29 20:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06bb90>
2026-03-29 20:25:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4859%252F18114859%252Fdocs_service_history-1769421294381.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df82de2a1c5b15f6fa7b0254c769c532e') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421294381.jpg?ixlib=js-3.8.0&auto=format&s=f82de2a1c5b15f6fa7b0254c769c532e saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421276941.jpg?ixlib=js-3.8.0&auto=format&s=6f289c143af28e74e88b2c0b6d71e344> (referer: None)
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4859/18114859/interior_rear_seats-1774778343383.jpg> (referer: None)
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4859/18114859/interior_boot-1774778433903.jpg> (referer: None)
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22e650>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4859%252F18114859%252Fdocs_service_history-1769421276941.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6f289c143af28e74e88b2c0b6d71e344') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421276941.jpg?ixlib=js-3.8.0&auto=format&s=6f289c143af28e74e88b2c0b6d71e344 saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf7e90>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4859%252F18114859%252Finterior_rear_seats-1774778343383.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4859/18114859/interior_rear_seats-1774778343383.jpg saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4859/18114859/interior_dashboard-1774778545678.jpg> (referer: None)
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22c6d0>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4859%252F18114859%252Finterior_boot-1774778433903.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4859/18114859/interior_boot-1774778433903.jpg saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2932d0>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Finterior_dashboard-1774778545678.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/interior_dashboard-1774778545678.jpg saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_passenger-1774778190409.jpg> (referer: None)
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_passenger-1774778114989.jpg> (referer: None)
2026-03-29 20:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4859/18114859/interior_front_seats-1774778309900.jpg> (referer: None)
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc150f9dd0>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_rear_passenger-1774778190409.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_passenger-1774778190409.jpg saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e085c90>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_front_passenger-1774778114989.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_passenger-1774778114989.jpg saved to cache
2026-03-29 20:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0ecd0>
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4859%252F18114859%252Finterior_front_seats-1774778309900.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4859/18114859/interior_front_seats-1774778309900.jpg saved to cache
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_passenger-1774773591778.jpg> (referer: None)
2026-03-29 20:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_driver-1774778192148.jpg> (referer: None)
2026-03-29 20:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_driver-1774778089337.jpg> (referer: None)
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c231990>
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_rear_passenger-1774773591778.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_passenger-1774773591778.jpg saved to cache
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22a050>
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_rear_driver-1774778192148.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_driver-1774778192148.jpg saved to cache
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d020410>
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4859%252F18114859%252Fexterior_front_driver-1774778089337.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_driver-1774778089337.jpg saved to cache
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d4795af-5f7a-506a-b0cc-82e1455731d7
2026-03-29 20:25:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d4795af-5f7a-506a-b0cc-82e1455731d7, skipping ID generation
2026-03-29 20:25:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d4795af-5f7a-506a-b0cc-82e1455731d7 with scrape type 1
2026-03-29 20:25:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d4795af-5f7a-506a-b0cc-82e1455731d7 sending to next pipeline
2026-03-29 20:25:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8d4795af-5f7a-506a-b0cc-82e1455731d7, identifier: 18114859
2026-03-29 20:25:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8d4795af-5f7a-506a-b0cc-82e1455731d7 with identifier: 18114859
2026-03-29 20:25:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8d4795af-5f7a-506a-b0cc-82e1455731d7 with identifier: 18114859
2026-03-29 20:25:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8d4795af-5f7a-506a-b0cc-82e1455731d7 with identifier: 18114859 to the API
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_driver-1774778089337.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8d4795af-5f7a-506a-b0cc-82e1455731d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BM04 OSB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18114859',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 35570,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2464562,
'Height': 2848,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_driver-1774778089337.jpg',
'Width': 3797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1925135,
'Height': 2841,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_driver-1774778192148.jpg',
'Width': 3788},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2133740,
'Height': 2857,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_front_passenger-1774778114989.jpg',
'Width': 3809},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2284268,
'Height': 2876,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4859/18114859/exterior_rear_passenger-1774778190409.jpg',
'Width': 3834},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3127284,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4859/18114859/interior_front_seats-1774778309900.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2639697,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4859/18114859/interior_rear_seats-1774778343383.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2508572,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4859/18114859/interior_dashboard-1774778545678.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1939522,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4859/18114859/interior_boot-1774778433903.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198260,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421276941.jpg?ixlib=js-3.8.0&auto=format&s=6f289c143af28e74e88b2c0b6d71e344',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4795af-5f7a-506a-b0cc-82e1455731d7/8d4795af-5f7a-506a-b0cc-82e1455731d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240448,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/4859/18114859/docs_service_history-1769421294381.jpg?ixlib=js-3.8.0&auto=format&s=f82de2a1c5b15f6fa7b0254c769c532e',
'Width': 1080}],
'price': 7240,
'price_includes_vat': False,
'registration_date': '2022-06-09',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Sandero Stepway Comfort TCE',
'transmission': 'manual',
'trim': 'Stepway Comfort TCE',
'vin': 'UU1DJF00669237466',
'year': 2022}
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718114859%27 HTTP/1.1" 200 None
2026-03-29 20:25:41 [motorway.uk] INFO: Saving data for 18114859: {'created_time': 1774815941.5957, 'last_price_update_time': 1774815941.59571, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18114859') HTTP/1.1" 204 0
2026-03-29 20:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_driver-1774773453364.jpg> (referer: None)
2026-03-29 20:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_driver-1774773481885.jpg> (referer: None)
2026-03-29 20:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_passenger-1774773552708.jpg> (referer: None)
2026-03-29 20:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8750/5678750/interior_dashboard-1774699000645.jpg> (referer: None)
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c251010>
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_front_driver-1774773453364.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_driver-1774773453364.jpg saved to cache
2026-03-29 20:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb02650>
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_rear_driver-1774773481885.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_driver-1774773481885.jpg saved to cache
2026-03-29 20:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7bf10>
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9049%252F20129049%252Fexterior_front_passenger-1774773552708.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_passenger-1774773552708.jpg saved to cache
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c
2026-03-29 20:25:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b4d7692-9d1e-52a7-914a-d1c89684ed1c, skipping ID generation
2026-03-29 20:25:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c with scrape type 1
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b4d7692-9d1e-52a7-914a-d1c89684ed1c sending to next pipeline
2026-03-29 20:25:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6b4d7692-9d1e-52a7-914a-d1c89684ed1c, identifier: 20129049
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1159d0>
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Finterior_dashboard-1774699000645.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/interior_dashboard-1774699000645.jpg saved to cache
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6b4d7692-9d1e-52a7-914a-d1c89684ed1c with identifier: 20129049
2026-03-29 20:25:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6b4d7692-9d1e-52a7-914a-d1c89684ed1c with identifier: 20129049
2026-03-29 20:25:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6b4d7692-9d1e-52a7-914a-d1c89684ed1c with identifier: 20129049 to the API
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_passenger-1774773552708.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6b4d7692-9d1e-52a7-914a-d1c89684ed1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EJ22 ZJV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20129049',
'listing': 'auction',
'location': 'Essex Colchester',
'make': 'Ford',
'model': 'Puma',
'odometer': 19880,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1996928,
'Height': 2758,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_driver-1774773453364.jpg',
'Width': 3677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 969766,
'Height': 2003,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_driver-1774773481885.jpg',
'Width': 2671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1619385,
'Height': 2597,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_front_passenger-1774773552708.jpg',
'Width': 3463},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1136925,
'Height': 2093,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9049/20129049/exterior_rear_passenger-1774773591778.jpg',
'Width': 2790},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3549341,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9049/20129049/interior_front_seats-1774774413399.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2986431,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9049/20129049/interior_rear_seats-1774773972854.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2322480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9049/20129049/interior_dashboard-1774773943444.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3252688,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9049/20129049/instrument_cluster-1774774310168.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3238400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9049/20129049/interior_boot-1774773908332.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b4d7692-9d1e-52a7-914a-d1c89684ed1c/6b4d7692-9d1e-52a7-914a-d1c89684ed1c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769175,
'Height': 2868,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9049/20129049/docs_service_history-1774774471244.jpg?ixlib=js-3.8.0&auto=format&s=6b16e8b73dac927c60a3ff141d943ff2',
'Width': 1320}],
'price': 13008,
'price_includes_vat': False,
'registration_date': '2022-06-09',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma ST-LINE X MHEV',
'transmission': 'manual',
'trim': 'ST-LINE X MHEV',
'vin': 'WF02XXERK2NS88127',
'year': 2022}
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720129049%27 HTTP/1.1" 200 None
2026-03-29 20:25:42 [motorway.uk] INFO: Saving data for 20129049: {'created_time': 1774815942.763594, 'last_price_update_time': 1774815942.763605, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20129049') HTTP/1.1" 204 0
2026-03-29 20:25:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_passenger-1774698344589.jpg> (referer: None)
2026-03-29 20:25:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8750/5678750/interior_front_seats-1774699042784.jpg> (referer: None)
2026-03-29 20:25:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8750/5678750/interior_rear_seats-1774698960143.jpg> (referer: None)
2026-03-29 20:25:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_passenger-1774698361491.jpg> (referer: None)
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e050d10>
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_rear_passenger-1774698344589.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_passenger-1774698344589.jpg saved to cache
2026-03-29 20:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d01df90>
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8750%252F5678750%252Finterior_front_seats-1774699042784.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8750/5678750/interior_front_seats-1774699042784.jpg saved to cache
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9684d0>
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8750%252F5678750%252Finterior_rear_seats-1774698960143.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8750/5678750/interior_rear_seats-1774698960143.jpg saved to cache
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e97ae10>
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_front_passenger-1774698361491.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_passenger-1774698361491.jpg saved to cache
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_driver-1774698307886.jpg> (referer: None)
2026-03-29 20:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9253/1379253/interior_dashboard-1774696892962.jpg> (referer: None)
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a1b10>
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8750%252F5678750%252Fexterior_front_driver-1774698307886.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_driver-1774698307886.jpg saved to cache
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0d996b3-3e0a-57e5-8712-d65396fcf68b
2026-03-29 20:25:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0d996b3-3e0a-57e5-8712-d65396fcf68b, skipping ID generation
2026-03-29 20:25:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d996b3-3e0a-57e5-8712-d65396fcf68b with scrape type 1
2026-03-29 20:25:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0d996b3-3e0a-57e5-8712-d65396fcf68b sending to next pipeline
2026-03-29 20:25:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e0d996b3-3e0a-57e5-8712-d65396fcf68b, identifier: 5678750
2026-03-29 20:25:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e0d996b3-3e0a-57e5-8712-d65396fcf68b with identifier: 5678750
2026-03-29 20:25:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e0d996b3-3e0a-57e5-8712-d65396fcf68b with identifier: 5678750
2026-03-29 20:25:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e0d996b3-3e0a-57e5-8712-d65396fcf68b with identifier: 5678750 to the API
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_driver-1774698307886.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e0d996b3-3e0a-57e5-8712-d65396fcf68b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CP68 KNE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5678750',
'listing': 'auction',
'location': 'West Berkshire Thatcham',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 84600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1866294,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_driver-1774698307886.jpg',
'Width': 3299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1662481,
'Height': 2505,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_driver-1774698324498.jpg',
'Width': 3340},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870364,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_front_passenger-1774698361491.jpg',
'Width': 3254},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1529753,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8750/5678750/exterior_rear_passenger-1774698344589.jpg',
'Width': 2950},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2431043,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8750/5678750/interior_front_seats-1774699042784.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3960087,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8750/5678750/interior_rear_seats-1774698960143.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630136,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8750/5678750/interior_dashboard-1774699000645.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087996,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8750/5678750/instrument_cluster-1774699028035.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3504388,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8750/5678750/interior_boot-1774699002567.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d996b3-3e0a-57e5-8712-d65396fcf68b/e0d996b3-3e0a-57e5-8712-d65396fcf68b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 926271,
'Height': 3329,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8750/5678750/docs_service_history-1774699364196.jpg?ixlib=js-3.8.0&auto=format&s=9aa8791033dbd835d206efca70a3eee9',
'Width': 2350}],
'price': 11459,
'price_includes_vat': False,
'registration_date': '2018-12-31',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf GTI Performance TSI',
'transmission': 'manual',
'trim': 'GTI Performance TSI',
'vin': 'WVWZZZAUZKW065591',
'year': 2018}
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275678750%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [motorway.uk] INFO: Saving data for 5678750: {'created_time': 1774815944.105149, 'last_price_update_time': 1774815944.10516, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5678750') HTTP/1.1" 204 0
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cede750>
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Finterior_dashboard-1774696892962.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/interior_dashboard-1774696892962.jpg saved to cache
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_front_passenger-1774679737955.jpg> (referer: None)
2026-03-29 20:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9253/1379253/interior_rear_seats-1774680183621.jpg> (referer: None)
2026-03-29 20:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9253/1379253/interior_front_seats-1774696942443.jpg> (referer: None)
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ef350>
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9253%252F1379253%252Fexterior_front_passenger-1774679737955.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_front_passenger-1774679737955.jpg saved to cache
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20422292.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e75d0>
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9253%252F1379253%252Finterior_rear_seats-1774680183621.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9253/1379253/interior_rear_seats-1774680183621.jpg saved to cache
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7a150>
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Finterior_front_seats-1774696942443.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/interior_front_seats-1774696942443.jpg saved to cache
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:25:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209393ff-1a54-5fc8-998b-e4f1488829ae with identifier: 20422292
2026-03-29 20:25:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209393ff-1a54-5fc8-998b-e4f1488829ae with scrape type 1
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_front_driver-1774706001177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_driver-1774706001177.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_rear_driver-1774706031670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_driver-1774706031670.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_front_passenger-1774706084229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_passenger-1774706084229.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_rear_passenger-1774706059523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_passenger-1774706059523.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2292%252F20422292%252Finterior_front_seats-1774706537354.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2292/20422292/interior_front_seats-1774706537354.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2292%252F20422292%252Finterior_rear_seats-1774706682279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2292/20422292/interior_rear_seats-1774706682279.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2292%252F20422292%252Finterior_dashboard-1774765938719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2292/20422292/interior_dashboard-1774765938719.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Finstrument_cluster-1774706622378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/instrument_cluster-1774706622378.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2292%252F20422292%252Finterior_boot-1774706639794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2292/20422292/interior_boot-1774706639794.jpg not downloaded yet
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2292%252F20422292%252Fdocs_service_history-1774707874491.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D75543c506a2f7450fedef06404e7fa58%27 HTTP/1.1" 200 None
2026-03-29 20:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2292/20422292/docs_service_history-1774707874491.jpg?ixlib=js-3.8.0&auto=format&s=75543c506a2f7450fedef06404e7fa58 not downloaded yet
2026-03-29 20:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_rear_driver-1774679721206.jpg> (referer: None)
2026-03-29 20:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9253/1379253/exterior_front_driver-1774696910754.jpg> (referer: None)
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31f0d0>
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9253%252F1379253%252Fexterior_rear_driver-1774679721206.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_rear_driver-1774679721206.jpg saved to cache
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31c650>
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9253%252F1379253%252Fexterior_front_driver-1774696910754.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9253/1379253/exterior_front_driver-1774696910754.jpg saved to cache
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f
2026-03-29 20:25:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f, skipping ID generation
2026-03-29 20:25:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f with scrape type 1
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f sending to next pipeline
2026-03-29 20:25:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f, identifier: 1379253
2026-03-29 20:25:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f with identifier: 1379253
2026-03-29 20:25:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f with identifier: 1379253
2026-03-29 20:25:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3cd4b3b2-c954-5a7b-b14c-6c81b156e57f with identifier: 1379253 to the API
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9253/1379253/exterior_front_driver-1774696910754.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3cd4b3b2-c954-5a7b-b14c-6c81b156e57f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DA21 SBZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/1379253',
'listing': 'auction',
'location': 'Greater Manchester Altrincham',
'make': 'Audi',
'model': 'Q5',
'odometer': 45869,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2129946,
'Height': 2527,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9253/1379253/exterior_front_driver-1774696910754.jpg',
'Width': 3369},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007449,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_rear_driver-1774679721206.jpg',
'Width': 3603},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1255106,
'Height': 2159,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9253/1379253/exterior_front_passenger-1774679737955.jpg',
'Width': 2878},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2994961,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9253/1379253/interior_front_seats-1774696942443.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3622150,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9253/1379253/interior_rear_seats-1774680183621.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673950,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9253/1379253/interior_dashboard-1774696892962.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2484636,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9253/1379253/instrument_cluster-1774680170872.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3908610,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9253/1379253/interior_boot-1774680126228.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd4b3b2-c954-5a7b-b14c-6c81b156e57f/3cd4b3b2-c954-5a7b-b14c-6c81b156e57f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671040,
'Height': 2396,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9253/1379253/docs_service_history-1774680291484.jpg?ixlib=js-3.8.0&auto=format&s=da20cd3feda024b061f029d6bc28f657',
'Width': 3230}],
'price': 22992,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q5 Sport 40 TDI MHEV Quat',
'transmission': 'automatic',
'trim': 'Sport 40 TDI MHEV Quat',
'vin': 'WAUZZZFY5M2039849',
'year': 2021}
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271379253%27 HTTP/1.1" 200 None
2026-03-29 20:25:45 [motorway.uk] INFO: Saving data for 1379253: {'created_time': 1774815945.669669, 'last_price_update_time': 1774815945.669679, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='1379253') HTTP/1.1" 204 0
2026-03-29 20:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2292/20422292/docs_service_history-1774707874491.jpg?ixlib=js-3.8.0&auto=format&s=75543c506a2f7450fedef06404e7fa58> (referer: None)
2026-03-29 20:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2836/19812836/interior_dashboard-1774708656665.jpg> (referer: None)
2026-03-29 20:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2836/19812836/instrument_cluster-1774704392088.jpg> (referer: None)
2026-03-29 20:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2836/19812836/interior_boot-1774704381892.jpg> (referer: None)
2026-03-29 20:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2292/20422292/interior_boot-1774706639794.jpg> (referer: None)
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31cd10>
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2292%252F20422292%252Fdocs_service_history-1774707874491.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D75543c506a2f7450fedef06404e7fa58') HTTP/1.1" 204 0
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2292/20422292/docs_service_history-1774707874491.jpg?ixlib=js-3.8.0&auto=format&s=75543c506a2f7450fedef06404e7fa58 saved to cache
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4ca50>
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2836%252F19812836%252Finterior_dashboard-1774708656665.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2836/19812836/interior_dashboard-1774708656665.jpg saved to cache
2026-03-29 20:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976a50>
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Finstrument_cluster-1774704392088.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/instrument_cluster-1774704392088.jpg saved to cache
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e092390>
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2836%252F19812836%252Finterior_boot-1774704381892.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2836/19812836/interior_boot-1774704381892.jpg saved to cache
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca62d0>
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2292%252F20422292%252Finterior_boot-1774706639794.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2292/20422292/interior_boot-1774706639794.jpg saved to cache
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2292/20422292/interior_dashboard-1774765938719.jpg> (referer: None)
2026-03-29 20:25:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2292/20422292/instrument_cluster-1774706622378.jpg> (referer: None)
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e090590>
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2292%252F20422292%252Finterior_dashboard-1774765938719.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2292/20422292/interior_dashboard-1774765938719.jpg saved to cache
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24e2d0>
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Finstrument_cluster-1774706622378.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/instrument_cluster-1774706622378.jpg saved to cache
2026-03-29 20:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_passenger-1774706059523.jpg> (referer: None)
2026-03-29 20:25:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_driver-1774706031670.jpg> (referer: None)
2026-03-29 20:25:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2292/20422292/interior_rear_seats-1774706682279.jpg> (referer: None)
2026-03-29 20:25:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2292/20422292/interior_front_seats-1774706537354.jpg> (referer: None)
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0c3d0>
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_rear_passenger-1774706059523.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_passenger-1774706059523.jpg saved to cache
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cc210>
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_rear_driver-1774706031670.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_driver-1774706031670.jpg saved to cache
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce40910>
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2292%252F20422292%252Finterior_rear_seats-1774706682279.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2292/20422292/interior_rear_seats-1774706682279.jpg saved to cache
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_driver-1774706001177.jpg> (referer: None)
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebe9a50>
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2292%252F20422292%252Finterior_front_seats-1774706537354.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2292/20422292/interior_front_seats-1774706537354.jpg saved to cache
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e090bd0>
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_front_driver-1774706001177.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_driver-1774706001177.jpg saved to cache
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2836/19812836/interior_rear_seats-1774704299972.jpg> (referer: None)
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec45c90>
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2836%252F19812836%252Finterior_rear_seats-1774704299972.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2836/19812836/interior_rear_seats-1774704299972.jpg saved to cache
2026-03-29 20:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_driver-1774704011298.jpg> (referer: None)
2026-03-29 20:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_passenger-1774704057168.jpg> (referer: None)
2026-03-29 20:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2836/19812836/interior_front_seats-1774704287232.jpg> (referer: None)
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05ef10>
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_rear_driver-1774704011298.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_driver-1774704011298.jpg saved to cache
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_passenger-1774704025387.jpg> (referer: None)
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced4a50>
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_front_passenger-1774704057168.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_passenger-1774704057168.jpg saved to cache
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093350>
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2836%252F19812836%252Finterior_front_seats-1774704287232.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2836/19812836/interior_front_seats-1774704287232.jpg saved to cache
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc03650>
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_rear_passenger-1774704025387.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_passenger-1774704025387.jpg saved to cache
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_driver-1774704006053.jpg> (referer: None)
2026-03-29 20:25:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_passenger-1774706084229.jpg> (referer: None)
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafb710>
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2836%252F19812836%252Fexterior_front_driver-1774704006053.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_driver-1774704006053.jpg saved to cache
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19
2026-03-29 20:25:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74d2bd9a-e1f3-5890-823a-bebd0f011c19, skipping ID generation
2026-03-29 20:25:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19 with scrape type 1
2026-03-29 20:25:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74d2bd9a-e1f3-5890-823a-bebd0f011c19 sending to next pipeline
2026-03-29 20:25:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 74d2bd9a-e1f3-5890-823a-bebd0f011c19, identifier: 19812836
2026-03-29 20:25:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 74d2bd9a-e1f3-5890-823a-bebd0f011c19 with identifier: 19812836
2026-03-29 20:25:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 74d2bd9a-e1f3-5890-823a-bebd0f011c19 with identifier: 19812836
2026-03-29 20:25:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 74d2bd9a-e1f3-5890-823a-bebd0f011c19 with identifier: 19812836 to the API
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_driver-1774704006053.jpg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '74d2bd9a-e1f3-5890-823a-bebd0f011c19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NY15 HDD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19812836',
'listing': 'auction',
'location': 'North Somerset Bristol',
'make': 'BMW',
'model': 'M4',
'odometer': 15000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1301581,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_driver-1774704006053.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1245313,
'Height': 2259,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_driver-1774704011298.jpg',
'Width': 3012},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1759120,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_front_passenger-1774704057168.jpg',
'Width': 3102},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2001702,
'Height': 2454,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2836/19812836/exterior_rear_passenger-1774704025387.jpg',
'Width': 3272},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727661,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2836/19812836/interior_front_seats-1774704287232.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2960595,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2836/19812836/interior_rear_seats-1774704299972.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2678668,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2836/19812836/interior_dashboard-1774708656665.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3188689,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2836/19812836/instrument_cluster-1774704392088.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3678013,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2836/19812836/interior_boot-1774704381892.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74d2bd9a-e1f3-5890-823a-bebd0f011c19/74d2bd9a-e1f3-5890-823a-bebd0f011c19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2108242,
'Height': 2617,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2836/19812836/docs_service_history-1774704641431.jpg?ixlib=js-3.8.0&auto=format&s=cb669d385c3916f342e65b2bf394be37',
'Width': 1767}],
'price': 21319,
'price_includes_vat': False,
'registration_date': '2015-08-24',
'seats_number': None,
'seller_name': None,
'title': 'BMW M4 S-A',
'transmission': 'automatic',
'trim': 'S-A',
'vin': 'WBS3U92040J967524',
'year': 2015}
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719812836%27 HTTP/1.1" 200 None
2026-03-29 20:25:49 [motorway.uk] INFO: Saving data for 19812836: {'created_time': 1774815949.066206, 'last_price_update_time': 1774815949.066221, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19812836') HTTP/1.1" 204 0
2026-03-29 20:25:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8d290>
2026-03-29 20:25:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2292%252F20422292%252Fexterior_front_passenger-1774706084229.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_passenger-1774706084229.jpg saved to cache
2026-03-29 20:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 209393ff-1a54-5fc8-998b-e4f1488829ae
2026-03-29 20:25:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 209393ff-1a54-5fc8-998b-e4f1488829ae, skipping ID generation
2026-03-29 20:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209393ff-1a54-5fc8-998b-e4f1488829ae with scrape type 1
2026-03-29 20:25:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 209393ff-1a54-5fc8-998b-e4f1488829ae sending to next pipeline
2026-03-29 20:25:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 209393ff-1a54-5fc8-998b-e4f1488829ae, identifier: 20422292
2026-03-29 20:25:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 209393ff-1a54-5fc8-998b-e4f1488829ae with identifier: 20422292
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey+%26+Black HTTP/1.1" 200 None
2026-03-29 20:25:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:25:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 209393ff-1a54-5fc8-998b-e4f1488829ae with identifier: 20422292
2026-03-29 20:25:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 209393ff-1a54-5fc8-998b-e4f1488829ae with identifier: 20422292 to the API
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_passenger-1774706084229.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '209393ff-1a54-5fc8-998b-e4f1488829ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK70 GKG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20422292',
'listing': 'auction',
'location': 'Kent Herne Bay',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 28000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1894689,
'Height': 2738,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_driver-1774706001177.jpg',
'Width': 3651},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1755639,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_driver-1774706031670.jpg',
'Width': 3658},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1861601,
'Height': 3023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_front_passenger-1774706084229.jpg',
'Width': 4030},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517913,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2292/20422292/exterior_rear_passenger-1774706059523.jpg',
'Width': 3452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3488490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2292/20422292/interior_front_seats-1774706537354.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3701106,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2292/20422292/interior_rear_seats-1774706682279.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2246135,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2292/20422292/interior_dashboard-1774765938719.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2430608,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2292/20422292/instrument_cluster-1774706622378.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3935031,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2292/20422292/interior_boot-1774706639794.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209393ff-1a54-5fc8-998b-e4f1488829ae/209393ff-1a54-5fc8-998b-e4f1488829ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701814,
'Height': 4103,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2292/20422292/docs_service_history-1774707874491.jpg?ixlib=js-3.8.0&auto=format&s=75543c506a2f7450fedef06404e7fa58',
'Width': 2894}],
'price': 16312,
'price_includes_vat': False,
'registration_date': '2020-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Toyota C-HR Dynamic HEV CVT',
'transmission': 'automatic',
'trim': 'Dynamic HEV CVT',
'vin': 'NMTK53BX10R026639',
'year': 2020}
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422292%27 HTTP/1.1" 200 None
2026-03-29 20:25:49 [motorway.uk] INFO: Saving data for 20422292: {'created_time': 1774815949.824704, 'last_price_update_time': 1774815949.824714, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20422292') HTTP/1.1" 204 0
2026-03-29 20:25:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20401260.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 with identifier: 20401260
2026-03-29 20:25:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 with scrape type 1
2026-03-29 20:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_front_driver-1774705333550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_driver-1774705333550.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_rear_driver-1774705345398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_driver-1774705345398.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_front_passenger-1774705368288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_passenger-1774705368288.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_rear_passenger-1774705356162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_passenger-1774705356162.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Finterior_front_seats-1774705815510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/interior_front_seats-1774705815510.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Finterior_rear_seats-1774705834998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/interior_rear_seats-1774705834998.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Finterior_dashboard-1774705871358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/interior_dashboard-1774705871358.jpg not downloaded yet
2026-03-29 20:25:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14040355.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Finstrument_cluster-1774705903656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/instrument_cluster-1774705903656.jpg not downloaded yet
2026-03-29 20:25:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Finterior_boot-1774705874995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/interior_boot-1774705874995.jpg not downloaded yet
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Fdamage_scratches-1774705491223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/damage_scratches-1774705491223.jpg not downloaded yet
2026-03-29 20:25:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e164df3d-8682-5ee9-a12c-52abe8f268c1 with identifier: 14040355
2026-03-29 20:25:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e164df3d-8682-5ee9-a12c-52abe8f268c1 with scrape type 1
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e164df3d-8682-5ee9-a12c-52abe8f268c1
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0355%252F14040355%252Fexterior_front_driver-1771604377618.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_front_driver-1771604377618.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0355%252F14040355%252Fexterior_rear_driver-1771604369056.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_rear_driver-1771604369056.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0355%252F14040355%252F14040355-exterior_front_passenger-modified-1771778395323.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0355/14040355/14040355-exterior_front_passenger-modified-1771778395323.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0355%252F14040355%252Fexterior_rear_passenger-1771604365041.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_rear_passenger-1771604365041.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0355%252F14040355%252Finterior_front_seats-1771604410615.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0355/14040355/interior_front_seats-1771604410615.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0355%252F14040355%252Finterior_rear_seats-1771604484911.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0355/14040355/interior_rear_seats-1771604484911.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0355%252F14040355%252F14040355-interior_dashboard-modified-1771778414529.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0355/14040355/14040355-interior_dashboard-modified-1771778414529.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0355%252F14040355%252Finstrument_cluster-1771604447736.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0355/14040355/instrument_cluster-1771604447736.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0355%252F14040355%252F14040355-interior_boot-modified-1771778430593.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0355/14040355/14040355-interior_boot-modified-1771778430593.jpeg already downloaded
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F0355%252F14040355%252Fdocs_service_history-1771758204474.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e19c9d0a08eefc0dafe160cf4e1a05c%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/0355/14040355/docs_service_history-1771758204474.jpeg?ixlib=js-3.8.0&auto=format&s=5e19c9d0a08eefc0dafe160cf4e1a05c already downloaded
2026-03-29 20:25:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e164df3d-8682-5ee9-a12c-52abe8f268c1, identifier: 14040355
2026-03-29 20:25:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e164df3d-8682-5ee9-a12c-52abe8f268c1 with identifier: 14040355
2026-03-29 20:25:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e164df3d-8682-5ee9-a12c-52abe8f268c1 with identifier: 14040355
2026-03-29 20:25:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e164df3d-8682-5ee9-a12c-52abe8f268c1 with identifier: 14040355 to the API
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14040355.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e164df3d-8682-5ee9-a12c-52abe8f268c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ17 VNX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14040355',
'listing': 'auction',
'location': 'Northumberland Morpeth',
'make': 'Audi',
'model': 'A1',
'odometer': 54817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_front_driver-1771604377618.jpeg',
'https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_rear_driver-1771604369056.jpeg',
'https://motorway-photos-modified.imgix.net/0355/14040355/14040355-exterior_front_passenger-modified-1771778395323.jpeg',
'https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_rear_passenger-1771604365041.jpeg',
'https://motorway-photos.imgix.net/0355/14040355/interior_front_seats-1771604410615.jpeg',
'https://motorway-photos.imgix.net/0355/14040355/interior_rear_seats-1771604484911.jpeg',
'https://motorway-photos-modified.imgix.net/0355/14040355/14040355-interior_dashboard-modified-1771778414529.jpeg',
'https://motorway-photos.imgix.net/0355/14040355/instrument_cluster-1771604447736.jpeg',
'https://motorway-photos-modified.imgix.net/0355/14040355/14040355-interior_boot-modified-1771778430593.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/0355/14040355/docs_service_history-1771758204474.jpeg?ixlib=js-3.8.0&auto=format&s=5e19c9d0a08eefc0dafe160cf4e1a05c'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1833778,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_front_driver-1771604377618.jpeg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1499612,
'Height': 2363,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_rear_driver-1771604369056.jpeg',
'Width': 3150},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3165867,
'Height': 2831,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0355/14040355/14040355-exterior_front_passenger-modified-1771778395323.jpeg',
'Width': 3775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2031393,
'Height': 2707,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0355/14040355/exterior_rear_passenger-1771604365041.jpeg',
'Width': 3609},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3705529,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0355/14040355/interior_front_seats-1771604410615.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3165467,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0355/14040355/interior_rear_seats-1771604484911.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2252654,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0355/14040355/14040355-interior_dashboard-modified-1771778414529.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2120107,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0355/14040355/instrument_cluster-1771604447736.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3774986,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0355/14040355/14040355-interior_boot-modified-1771778430593.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03056442-4c2a-50f7-b38b-8235cfe71a2a/03056442-4c2a-50f7-b38b-8235cfe71a2a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1963137,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/0355/14040355/docs_service_history-1771758204474.jpeg?ixlib=js-3.8.0&auto=format&s=5e19c9d0a08eefc0dafe160cf4e1a05c',
'Width': 4032}],
'price': 7701,
'price_includes_vat': False,
'registration_date': '2017-03-23',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport TFSI',
'transmission': 'manual',
'trim': 'Sport TFSI',
'vin': 'WAUZZZ8X8HB068921',
'year': 2017}
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714040355%27 HTTP/1.1" 200 None
2026-03-29 20:25:50 [motorway.uk] INFO: Saving data for 14040355: {'created_time': 1774815950.89139, 'last_price_update_time': 1774815950.8914, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14040355') HTTP/1.1" 204 0
2026-03-29 20:25:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1260/20401260/interior_dashboard-1774705871358.jpg> (referer: None)
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11ca10>
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Finterior_dashboard-1774705871358.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/interior_dashboard-1774705871358.jpg saved to cache
2026-03-29 20:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1260/20401260/damage_scratches-1774705491223.jpg> (referer: None)
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e092b50>
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Fdamage_scratches-1774705491223.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/damage_scratches-1774705491223.jpg saved to cache
2026-03-29 20:25:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1260/20401260/interior_boot-1774705874995.jpg> (referer: None)
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ede9210>
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Finterior_boot-1774705874995.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/interior_boot-1774705874995.jpg saved to cache
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1260/20401260/instrument_cluster-1774705903656.jpg> (referer: None)
2026-03-29 20:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12444904.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:25:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05d5d0>
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Finstrument_cluster-1774705903656.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/instrument_cluster-1774705903656.jpg saved to cache
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6287a2ce-534f-53af-8ab2-c338e6d57f42 with identifier: 12444904
2026-03-29 20:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6287a2ce-534f-53af-8ab2-c338e6d57f42 with scrape type 1
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_front_driver-1774712238893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_driver-1774712238893.jpg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_rear_driver-1774712323258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_driver-1774712323258.jpg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_front_passenger-1774712255802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_passenger-1774712255802.jpg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_rear_passenger-1774712350209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_passenger-1774712350209.jpg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4904%252F12444904%252F12444904-interior_front_seats-modified-1774715134387.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_front_seats-modified-1774715134387.jpeg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4904%252F12444904%252Finterior_rear_seats-1774712496151.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4904/12444904/interior_rear_seats-1774712496151.jpg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4904%252F12444904%252F12444904-interior_dashboard-modified-1774717417550.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_dashboard-modified-1774717417550.jpeg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4904%252F12444904%252F12444904-instrument_cluster-modified-1774715143834.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4904/12444904/12444904-instrument_cluster-modified-1774715143834.jpeg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4904%252F12444904%252Finterior_boot-1774712549480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4904/12444904/interior_boot-1774712549480.jpg not downloaded yet
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4904%252F12444904%252Fdocs_service_history-1774713504752.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4c4f3a9676c77d9d6a4db08da8b0be78%27 HTTP/1.1" 200 None
2026-03-29 20:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4904/12444904/docs_service_history-1774713504752.jpg?ixlib=js-3.8.0&auto=format&s=4c4f3a9676c77d9d6a4db08da8b0be78 not downloaded yet
2026-03-29 20:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1260/20401260/interior_front_seats-1774705815510.jpg> (referer: None)
2026-03-29 20:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1260/20401260/interior_rear_seats-1774705834998.jpg> (referer: None)
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7863d0>
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Finterior_front_seats-1774705815510.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/interior_front_seats-1774705815510.jpg saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:25:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:25:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:25:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafb3d0>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1260%252F20401260%252Finterior_rear_seats-1774705834998.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1260/20401260/interior_rear_seats-1774705834998.jpg saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4904/12444904/docs_service_history-1774713504752.jpg?ixlib=js-3.8.0&auto=format&s=4c4f3a9676c77d9d6a4db08da8b0be78> (referer: None)
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4904/12444904/interior_boot-1774712549480.jpg> (referer: None)
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03ced0>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4904%252F12444904%252Fdocs_service_history-1774713504752.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4c4f3a9676c77d9d6a4db08da8b0be78') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4904/12444904/docs_service_history-1774713504752.jpg?ixlib=js-3.8.0&auto=format&s=4c4f3a9676c77d9d6a4db08da8b0be78 saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eade1d0>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4904%252F12444904%252Finterior_boot-1774712549480.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4904/12444904/interior_boot-1774712549480.jpg saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4904/12444904/12444904-instrument_cluster-modified-1774715143834.jpeg> (referer: None)
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_dashboard-modified-1774717417550.jpeg> (referer: None)
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd9510>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4904%252F12444904%252F12444904-instrument_cluster-modified-1774715143834.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4904/12444904/12444904-instrument_cluster-modified-1774715143834.jpeg saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4904/12444904/interior_rear_seats-1774712496151.jpg> (referer: None)
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadd410>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4904%252F12444904%252F12444904-interior_dashboard-modified-1774717417550.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_dashboard-modified-1774717417550.jpeg saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadc450>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4904%252F12444904%252Finterior_rear_seats-1774712496151.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4904/12444904/interior_rear_seats-1774712496151.jpg saved to cache
2026-03-29 20:25:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_passenger-1774712350209.jpg> (referer: None)
2026-03-29 20:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_front_seats-modified-1774715134387.jpeg> (referer: None)
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebea010>
2026-03-29 20:25:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_rear_passenger-1774712350209.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_passenger-1774712350209.jpg saved to cache
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22de90>
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4904%252F12444904%252F12444904-interior_front_seats-modified-1774715134387.jpeg') HTTP/1.1" 204 0
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_front_seats-modified-1774715134387.jpeg saved to cache
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_driver-1774712323258.jpg> (referer: None)
2026-03-29 20:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_passenger-1774712255802.jpg> (referer: None)
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d786290>
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_rear_driver-1774712323258.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_driver-1774712323258.jpg saved to cache
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_driver-1774712238893.jpg> (referer: None)
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e03d450>
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_front_passenger-1774712255802.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_passenger-1774712255802.jpg saved to cache
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_passenger-1774705356162.jpg> (referer: None)
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d784990>
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4904%252F12444904%252Fexterior_front_driver-1774712238893.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_driver-1774712238893.jpg saved to cache
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6287a2ce-534f-53af-8ab2-c338e6d57f42
2026-03-29 20:25:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6287a2ce-534f-53af-8ab2-c338e6d57f42, skipping ID generation
2026-03-29 20:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6287a2ce-534f-53af-8ab2-c338e6d57f42 with scrape type 1
2026-03-29 20:25:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6287a2ce-534f-53af-8ab2-c338e6d57f42 sending to next pipeline
2026-03-29 20:25:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6287a2ce-534f-53af-8ab2-c338e6d57f42, identifier: 12444904
2026-03-29 20:25:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6287a2ce-534f-53af-8ab2-c338e6d57f42 with identifier: 12444904
2026-03-29 20:25:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6287a2ce-534f-53af-8ab2-c338e6d57f42 with identifier: 12444904
2026-03-29 20:25:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6287a2ce-534f-53af-8ab2-c338e6d57f42 with identifier: 12444904 to the API
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_driver-1774712238893.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6287a2ce-534f-53af-8ab2-c338e6d57f42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WM17 BCZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12444904',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 47218,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548965,
'Height': 1918,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_driver-1774712238893.jpg',
'Width': 2557},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 915392,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_driver-1774712323258.jpg',
'Width': 3095},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 806028,
'Height': 1954,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_front_passenger-1774712255802.jpg',
'Width': 2605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1114151,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4904/12444904/exterior_rear_passenger-1774712350209.jpg',
'Width': 3359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468350,
'Height': 2261,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_front_seats-modified-1774715134387.jpeg',
'Width': 3014},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1056446,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4904/12444904/interior_rear_seats-1774712496151.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1890788,
'Height': 2779,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4904/12444904/12444904-interior_dashboard-modified-1774717417550.jpeg',
'Width': 3706},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95462,
'Height': 844,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4904/12444904/12444904-instrument_cluster-modified-1774715143834.jpeg',
'Width': 1125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1222159,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4904/12444904/interior_boot-1774712549480.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6287a2ce-534f-53af-8ab2-c338e6d57f42/6287a2ce-534f-53af-8ab2-c338e6d57f42_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476878,
'Height': 2436,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4904/12444904/docs_service_history-1774713504752.jpg?ixlib=js-3.8.0&auto=format&s=4c4f3a9676c77d9d6a4db08da8b0be78',
'Width': 1800}],
'price': 13435,
'price_includes_vat': False,
'registration_date': '2017-06-07',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 300 AMG Line Auto',
'transmission': 'automatic',
'trim': 'C 300 AMG Line Auto',
'vin': 'WDD2053482F580830',
'year': 2017}
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712444904%27 HTTP/1.1" 200 None
2026-03-29 20:25:55 [motorway.uk] INFO: Saving data for 12444904: {'created_time': 1774815955.254614, 'last_price_update_time': 1774815955.254624, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12444904') HTTP/1.1" 204 0
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03f4d0>
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_rear_passenger-1774705356162.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_passenger-1774705356162.jpg saved to cache
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_driver-1774705345398.jpg> (referer: None)
2026-03-29 20:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_passenger-1774705368288.jpg> (referer: None)
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce438d0>
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_rear_driver-1774705345398.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_driver-1774705345398.jpg saved to cache
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2d710>
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_front_passenger-1774705368288.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_passenger-1774705368288.jpg saved to cache
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_driver-1774705333550.jpg> (referer: None)
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eadec90>
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1260%252F20401260%252Fexterior_front_driver-1774705333550.jpg') HTTP/1.1" 204 0
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_driver-1774705333550.jpg saved to cache
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21
2026-03-29 20:25:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21, skipping ID generation
2026-03-29 20:25:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 with scrape type 1
2026-03-29 20:25:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 sending to next pipeline
2026-03-29 20:25:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21, identifier: 20401260
2026-03-29 20:25:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 with identifier: 20401260
2026-03-29 20:25:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 with identifier: 20401260
2026-03-29 20:25:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 53de3c2e-b8a6-59d9-a9f0-6297a0edaa21 with identifier: 20401260 to the API
2026-03-29 20:25:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:25:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:25:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_driver-1774705333550.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '53de3c2e-b8a6-59d9-a9f0-6297a0edaa21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FG20 CAV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20401260',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Audi',
'model': 'Q3',
'odometer': 40987,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1011342,
'Height': 1958,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_driver-1774705333550.jpg',
'Width': 2610},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1001837,
'Height': 2069,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_driver-1774705345398.jpg',
'Width': 2759},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1802646,
'Height': 2657,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_front_passenger-1774705368288.jpg',
'Width': 3542},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1377788,
'Height': 2428,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1260/20401260/exterior_rear_passenger-1774705356162.jpg',
'Width': 3237},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4536494,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1260/20401260/interior_front_seats-1774705815510.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4225027,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1260/20401260/interior_rear_seats-1774705834998.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1798552,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1260/20401260/interior_dashboard-1774705871358.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2200389,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1260/20401260/instrument_cluster-1774705903656.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4850695,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1260/20401260/interior_boot-1774705874995.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53de3c2e-b8a6-59d9-a9f0-6297a0edaa21/53de3c2e-b8a6-59d9-a9f0-6297a0edaa21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2277957,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1260/20401260/damage_scratches-1774705491223.jpg',
'Width': 4032}],
'price': 15843,
'price_includes_vat': False,
'registration_date': '2020-06-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S Line 35 TFSI',
'transmission': 'manual',
'trim': 'S Line 35 TFSI',
'vin': 'WAUZZZF3XL1028600',
'year': 2020}
2026-03-29 20:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401260%27 HTTP/1.1" 200 None
2026-03-29 20:25:56 [motorway.uk] INFO: Saving data for 20401260: {'created_time': 1774815956.240522, 'last_price_update_time': 1774815956.240535, 'auction_closing_time': 1774884600.0}
2026-03-29 20:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20401260') HTTP/1.1" 204 0
2026-03-29 20:26:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20401398.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 with identifier: 20401398
2026-03-29 20:26:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 with scrape type 1
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_front_driver-1774704734227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_driver-1774704734227.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_rear_driver-1774704749678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_driver-1774704749678.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_front_passenger-1774705437760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_passenger-1774705437760.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_rear_passenger-1774704756624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_passenger-1774704756624.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1398%252F20401398%252Finterior_front_seats-1774772720745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1398/20401398/interior_front_seats-1774772720745.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1398%252F20401398%252Finterior_rear_seats-1774705129372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1398/20401398/interior_rear_seats-1774705129372.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1398%252F20401398%252Finterior_dashboard-1774772711559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1398/20401398/interior_dashboard-1774772711559.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Finstrument_cluster-1774705185211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/instrument_cluster-1774705185211.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1398%252F20401398%252Finterior_boot-1774705249687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1398/20401398/interior_boot-1774705249687.jpg not downloaded yet
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1398%252F20401398%252Fdocs_service_history-1774705836808.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D913b13479ca69c2ecc2aec5cfe998e5b%27 HTTP/1.1" 200 None
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1398/20401398/docs_service_history-1774705836808.jpg?ixlib=js-3.8.0&auto=format&s=913b13479ca69c2ecc2aec5cfe998e5b not downloaded yet
2026-03-29 20:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5756/20485756/interior_rear_seats-1774696215478.jpg> (referer: None)
2026-03-29 20:26:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4c890>
2026-03-29 20:26:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5756%252F20485756%252Finterior_rear_seats-1774696215478.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5756/20485756/interior_rear_seats-1774696215478.jpg saved to cache
2026-03-29 20:26:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1398/20401398/docs_service_history-1774705836808.jpg?ixlib=js-3.8.0&auto=format&s=913b13479ca69c2ecc2aec5cfe998e5b> (referer: None)
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13d250>
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1398%252F20401398%252Fdocs_service_history-1774705836808.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D913b13479ca69c2ecc2aec5cfe998e5b') HTTP/1.1" 204 0
2026-03-29 20:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1398/20401398/docs_service_history-1774705836808.jpg?ixlib=js-3.8.0&auto=format&s=913b13479ca69c2ecc2aec5cfe998e5b saved to cache
2026-03-29 20:26:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1398/20401398/interior_boot-1774705249687.jpg> (referer: None)
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecd610>
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1398%252F20401398%252Finterior_boot-1774705249687.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1398/20401398/interior_boot-1774705249687.jpg saved to cache
2026-03-29 20:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1398/20401398/instrument_cluster-1774705185211.jpg> (referer: None)
2026-03-29 20:26:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0c350>
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Finstrument_cluster-1774705185211.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/instrument_cluster-1774705185211.jpg saved to cache
2026-03-29 20:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1398/20401398/interior_dashboard-1774772711559.jpg> (referer: None)
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4ebd0>
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1398%252F20401398%252Finterior_dashboard-1774772711559.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1398/20401398/interior_dashboard-1774772711559.jpg saved to cache
2026-03-29 20:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:05 [scrapy.extensions.logstats] INFO: Crawled 241 pages (at 15 pages/min), scraped 196 items (at 20 items/min)
2026-03-29 20:26:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:26:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1398/20401398/interior_rear_seats-1774705129372.jpg> (referer: None)
2026-03-29 20:26:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4bd10>
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1398%252F20401398%252Finterior_rear_seats-1774705129372.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1398/20401398/interior_rear_seats-1774705129372.jpg saved to cache
2026-03-29 20:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1398/20401398/interior_front_seats-1774772720745.jpg> (referer: None)
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24cb50>
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1398%252F20401398%252Finterior_front_seats-1774772720745.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1398/20401398/interior_front_seats-1774772720745.jpg saved to cache
2026-03-29 20:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_passenger-1774704756624.jpg> (referer: None)
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13c750>
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_rear_passenger-1774704756624.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_passenger-1774704756624.jpg saved to cache
2026-03-29 20:26:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_passenger-1774705437760.jpg> (referer: None)
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24e150>
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_front_passenger-1774705437760.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_passenger-1774705437760.jpg saved to cache
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_driver-1774704749678.jpg> (referer: None)
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a1490>
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_rear_driver-1774704749678.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_driver-1774704749678.jpg saved to cache
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_driver-1774704734227.jpg> (referer: None)
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb972d0>
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1398%252F20401398%252Fexterior_front_driver-1774704734227.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_driver-1774704734227.jpg saved to cache
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2
2026-03-29 20:26:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a4335aa-378e-54ca-8848-cc0b6b3e92a2, skipping ID generation
2026-03-29 20:26:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 with scrape type 1
2026-03-29 20:26:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 sending to next pipeline
2026-03-29 20:26:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9a4335aa-378e-54ca-8848-cc0b6b3e92a2, identifier: 20401398
2026-03-29 20:26:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 with identifier: 20401398
2026-03-29 20:26:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 with identifier: 20401398
2026-03-29 20:26:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9a4335aa-378e-54ca-8848-cc0b6b3e92a2 with identifier: 20401398 to the API
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_driver-1774704734227.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9a4335aa-378e-54ca-8848-cc0b6b3e92a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LV66 YFT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20401398',
'listing': 'auction',
'location': 'North Somerset Clevedon',
'make': 'Audi',
'model': 'A3',
'odometer': 66000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1415779,
'Height': 2063,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_driver-1774704734227.jpg',
'Width': 2751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2088890,
'Height': 2559,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_driver-1774704749678.jpg',
'Width': 3412},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1632937,
'Height': 2456,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_front_passenger-1774705437760.jpg',
'Width': 3274},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1398827,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1398/20401398/exterior_rear_passenger-1774704756624.jpg',
'Width': 3158},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1830479,
'Height': 2297,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1398/20401398/interior_front_seats-1774772720745.jpg',
'Width': 3062},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4030116,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1398/20401398/interior_rear_seats-1774705129372.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 873772,
'Height': 1634,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1398/20401398/interior_dashboard-1774772711559.jpg',
'Width': 2178},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3164028,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1398/20401398/instrument_cluster-1774705185211.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4423156,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1398/20401398/interior_boot-1774705249687.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a4335aa-378e-54ca-8848-cc0b6b3e92a2/9a4335aa-378e-54ca-8848-cc0b6b3e92a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6661019,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1398/20401398/docs_service_history-1774705836808.jpg?ixlib=js-3.8.0&auto=format&s=913b13479ca69c2ecc2aec5cfe998e5b',
'Width': 4032}],
'price': 9226,
'price_includes_vat': False,
'registration_date': '2017-02-12',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line TFSI',
'transmission': 'manual',
'trim': 'S Line TFSI',
'vin': 'WAUZZZ8V4HA094145',
'year': 2017}
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401398%27 HTTP/1.1" 200 None
2026-03-29 20:26:08 [motorway.uk] INFO: Saving data for 20401398: {'created_time': 1774815968.347897, 'last_price_update_time': 1774815968.347907, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20401398') HTTP/1.1" 204 0
2026-03-29 20:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_passenger-1774695806153.jpg> (referer: None)
2026-03-29 20:26:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14310210>
2026-03-29 20:26:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_rear_passenger-1774695806153.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_passenger-1774695806153.jpg saved to cache
2026-03-29 20:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20130808.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b656e01-6907-5683-90f6-90015ad27258 with identifier: 20130808
2026-03-29 20:26:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b656e01-6907-5683-90f6-90015ad27258 with scrape type 2
2026-03-29 20:26:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b656e01-6907-5683-90f6-90015ad27258 with scrape type 2
2026-03-29 20:26:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0b656e01-6907-5683-90f6-90015ad27258, identifier: 20130808
2026-03-29 20:26:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0b656e01-6907-5683-90f6-90015ad27258 with identifier: 20130808
2026-03-29 20:26:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0b656e01-6907-5683-90f6-90015ad27258 with identifier: 20130808
2026-03-29 20:26:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0b656e01-6907-5683-90f6-90015ad27258 with identifier: 20130808 to the API
2026-03-29 20:26:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20130808.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0b656e01-6907-5683-90f6-90015ad27258',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FL22 EUC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20130808',
'listing': 'auction',
'location': 'Staffordshire Burton-on-Trent',
'make': 'Mazda',
'model': 'MX-5',
'odometer': 26474,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 19995,
'price_includes_vat': False,
'registration_date': '2022-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Mazda MX-5 RF Sport Tech',
'transmission': 'manual',
'trim': 'RF Sport Tech',
'vin': 'JMZND6E7600600206',
'year': 2022}
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720130808%27 HTTP/1.1" 200 None
2026-03-29 20:26:09 [motorway.uk] INFO: Saving data for 20130808: {'auction_closing_time': 1774884600.0, 'created_time': 1774556878.335417, 'last_price_update_time': 1774815969.136789}
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20130808') HTTP/1.1" 204 0
2026-03-29 20:26:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_passenger-1774695829036.jpg> (referer: None)
2026-03-29 20:26:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_driver-1774695801960.jpg> (referer: None)
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15d4d0>
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_front_passenger-1774695829036.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_passenger-1774695829036.jpg saved to cache
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15f150>
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_rear_driver-1774695801960.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_driver-1774695801960.jpg saved to cache
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:26:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_driver-1774695804999.jpg> (referer: None)
2026-03-29 20:26:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8099/20028099/interior_boot-1774619920439.jpg> (referer: None)
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d282210>
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5756%252F20485756%252Fexterior_front_driver-1774695804999.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_driver-1774695804999.jpg saved to cache
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74102b82-6c28-50fe-8f40-22c0c5bcceee
2026-03-29 20:26:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74102b82-6c28-50fe-8f40-22c0c5bcceee, skipping ID generation
2026-03-29 20:26:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74102b82-6c28-50fe-8f40-22c0c5bcceee with scrape type 1
2026-03-29 20:26:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74102b82-6c28-50fe-8f40-22c0c5bcceee sending to next pipeline
2026-03-29 20:26:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 74102b82-6c28-50fe-8f40-22c0c5bcceee, identifier: 20485756
2026-03-29 20:26:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 74102b82-6c28-50fe-8f40-22c0c5bcceee with identifier: 20485756
2026-03-29 20:26:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 74102b82-6c28-50fe-8f40-22c0c5bcceee with identifier: 20485756
2026-03-29 20:26:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 74102b82-6c28-50fe-8f40-22c0c5bcceee with identifier: 20485756 to the API
2026-03-29 20:26:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_driver-1774695804999.jpg>
{'auction_title': '',
'category': None,
'color': 'Gold',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '74102b82-6c28-50fe-8f40-22c0c5bcceee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CN63 AOO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485756',
'listing': 'auction',
'location': 'West Yorkshire Brighouse',
'make': 'Ford',
'model': 'B-MAX',
'odometer': 22031,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1401991,
'Height': 2596,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_driver-1774695804999.jpg',
'Width': 3461},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1529594,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_driver-1774695801960.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1380512,
'Height': 2740,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_front_passenger-1774695829036.jpg',
'Width': 3653},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539821,
'Height': 2840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5756/20485756/exterior_rear_passenger-1774695806153.jpg',
'Width': 3787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1290069,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5756/20485756/interior_front_seats-1774696213732.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588227,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5756/20485756/interior_rear_seats-1774696215478.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765661,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5756/20485756/interior_dashboard-1774696231331.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221101,
'Height': 1135,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5756/20485756/instrument_cluster-1774698946324.jpg',
'Width': 1514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169766,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5756/20485756/interior_boot-1774696217107.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74102b82-6c28-50fe-8f40-22c0c5bcceee/74102b82-6c28-50fe-8f40-22c0c5bcceee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859773,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5756/20485756/docs_service_history-1774696408097.jpg?ixlib=js-3.8.0&auto=format&s=bf46bfcf2a7ef3fab4bcb1c49e596dcc',
'Width': 3840}],
'price': 5180,
'price_includes_vat': False,
'registration_date': '2013-09-20',
'seats_number': None,
'seller_name': None,
'title': 'Ford B-MAX Titanium Auto',
'transmission': 'automatic',
'trim': 'Titanium Auto',
'vin': 'WF0KXXERJKDA76084',
'year': 2013}
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485756%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Saving data for 20485756: {'created_time': 1774815970.254743, 'last_price_update_time': 1774815970.254755, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485756') HTTP/1.1" 204 0
2026-03-29 20:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=900&page=25&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eaf5750>
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20028099%252Finterior_boot-1774619920439.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20028099/interior_boot-1774619920439.jpg saved to cache
2026-03-29 20:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8099/20028099/instrument_cluster-1774620907115.jpg> (referer: None)
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19778480
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20022290
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 13467302
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19297070
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719297070%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 19297070: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20020700
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 11255946
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19632065
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 17285204
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 16536787
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 1653589
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20323347
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720323347%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 20323347: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20483472
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483472%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 20483472: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 17018395
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 4109910
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274109910%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 4109910: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19834070
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20450033
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450033%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 20450033: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20441111
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441111%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 20441111: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 15806242
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20168276
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720168276%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 20168276: 1
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4c490>
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8099%252F20028099%252Finstrument_cluster-1774620907115.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8099/20028099/instrument_cluster-1774620907115.jpg saved to cache
2026-03-29 20:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 13753529
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 15549773
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 15733189
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 14461251
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20474635
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19400973
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20423010
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20470703
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470703%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 20470703: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 10736639
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710736639%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 10736639: 2
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20469304
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19886474
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719886474%27 HTTP/1.1" 200 None
2026-03-29 20:26:10 [motorway.uk] INFO: Scrape type for 19886474: 1
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 18670827
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 19915940
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 14572470
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20268898
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20241032
2026-03-29 20:26:10 [motorway.uk] INFO: Found listing with ID: 20251701
2026-03-29 20:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20028099/interior_dashboard-1774619862378.jpg> (referer: None)
2026-03-29 20:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8099/20028099/interior_rear_seats-1774619859056.jpg> (referer: None)
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15e610>
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Finterior_dashboard-1774619862378.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/interior_dashboard-1774619862378.jpg saved to cache
2026-03-29 20:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb01590>
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20028099%252Finterior_rear_seats-1774619859056.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20028099/interior_rear_seats-1774619859056.jpg saved to cache
2026-03-29 20:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8099/20028099/interior_front_seats-1774619870786.jpg> (referer: None)
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2bd350>
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8099%252F20028099%252Finterior_front_seats-1774619870786.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8099/20028099/interior_front_seats-1774619870786.jpg saved to cache
2026-03-29 20:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20309766.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be60bede-1eae-5d2e-bab6-c76293157e21 with identifier: 20309766
2026-03-29 20:26:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be60bede-1eae-5d2e-bab6-c76293157e21 with scrape type 1
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_front_driver-1774105379321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_driver-1774105379321.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_rear_driver-1774105399301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_driver-1774105399301.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_front_passenger-1774105437003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_passenger-1774105437003.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_rear_passenger-1774105413966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_passenger-1774105413966.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9766%252F20309766%252Finterior_front_seats-1774106160849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9766/20309766/interior_front_seats-1774106160849.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9766%252F20309766%252Finterior_rear_seats-1774106188137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9766/20309766/interior_rear_seats-1774106188137.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9766%252F20309766%252Finterior_dashboard-1774263829203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9766/20309766/interior_dashboard-1774263829203.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Finstrument_cluster-1774106256390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/instrument_cluster-1774106256390.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9766%252F20309766%252Finterior_boot-1774263840522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9766/20309766/interior_boot-1774263840522.jpg not downloaded yet
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9766%252F20309766%252Fdocs_service_history-1774107168859.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd5e41ebe0e29d593fe6f69a571f00750%27 HTTP/1.1" 200 None
2026-03-29 20:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9766/20309766/docs_service_history-1774107168859.jpg?ixlib=js-3.8.0&auto=format&s=d5e41ebe0e29d593fe6f69a571f00750 not downloaded yet
2026-03-29 20:26:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19995676.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c11d9c-0f45-55ef-ae58-6cd34218e371 with identifier: 19995676
2026-03-29 20:26:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c11d9c-0f45-55ef-ae58-6cd34218e371 with scrape type 1
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_front_driver-1774699249334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_driver-1774699249334.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_rear_driver-1774699200798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_driver-1774699200798.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_front_passenger-1774699336727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_passenger-1774699336727.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_rear_passenger-1774699291145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_passenger-1774699291145.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5676%252F19995676%252Finterior_front_seats-1774701075505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5676/19995676/interior_front_seats-1774701075505.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5676%252F19995676%252Finterior_rear_seats-1774701113791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5676/19995676/interior_rear_seats-1774701113791.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Finterior_dashboard-1774700443338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/interior_dashboard-1774700443338.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Finstrument_cluster-1774700447373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/instrument_cluster-1774700447373.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5676%252F19995676%252Finterior_boot-1774700479484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5676/19995676/interior_boot-1774700479484.jpg not downloaded yet
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5676%252F19995676%252Fdocs_service_history-1774702496671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcff4d20896766648b20f268c0bbf944d%27 HTTP/1.1" 200 None
2026-03-29 20:26:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5676/19995676/docs_service_history-1774702496671.jpg?ixlib=js-3.8.0&auto=format&s=cff4d20896766648b20f268c0bbf944d not downloaded yet
2026-03-29 20:26:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9766/20309766/docs_service_history-1774107168859.jpg?ixlib=js-3.8.0&auto=format&s=d5e41ebe0e29d593fe6f69a571f00750> (referer: None)
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc02f50>
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9766%252F20309766%252Fdocs_service_history-1774107168859.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd5e41ebe0e29d593fe6f69a571f00750') HTTP/1.1" 204 0
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9766/20309766/docs_service_history-1774107168859.jpg?ixlib=js-3.8.0&auto=format&s=d5e41ebe0e29d593fe6f69a571f00750 saved to cache
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469592.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5676/19995676/docs_service_history-1774702496671.jpg?ixlib=js-3.8.0&auto=format&s=cff4d20896766648b20f268c0bbf944d> (referer: None)
2026-03-29 20:26:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b with identifier: 20469592
2026-03-29 20:26:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b with scrape type 1
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_front_driver-1774700099737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_driver-1774700099737.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_rear_driver-1774700194087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_driver-1774700194087.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_front_passenger-1774700133595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_passenger-1774700133595.jpg not downloaded yet
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf01290>
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5676%252F19995676%252Fdocs_service_history-1774702496671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcff4d20896766648b20f268c0bbf944d') HTTP/1.1" 204 0
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5676/19995676/docs_service_history-1774702496671.jpg?ixlib=js-3.8.0&auto=format&s=cff4d20896766648b20f268c0bbf944d saved to cache
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_rear_passenger-1774700015938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_passenger-1774700015938.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9592%252F20469592%252Finterior_front_seats-1774702332193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9592/20469592/interior_front_seats-1774702332193.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9592%252F20469592%252Finterior_rear_seats-1774702323587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9592/20469592/interior_rear_seats-1774702323587.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Finterior_dashboard-1774702345361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/interior_dashboard-1774702345361.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Finstrument_cluster-1774702466694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/instrument_cluster-1774702466694.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9592%252F20469592%252Finterior_boot-1774702311660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9592/20469592/interior_boot-1774702311660.jpg not downloaded yet
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9592%252F20469592%252Fdocs_service_history-1774703503104.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D282d72da42dbc0798d76ac6f3166e3ca%27 HTTP/1.1" 200 None
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9592/20469592/docs_service_history-1774703503104.jpg?ixlib=js-3.8.0&auto=format&s=282d72da42dbc0798d76ac6f3166e3ca not downloaded yet
2026-03-29 20:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5676/19995676/interior_boot-1774700479484.jpg> (referer: None)
2026-03-29 20:26:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5676/19995676/instrument_cluster-1774700447373.jpg> (referer: None)
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03d790>
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5676%252F19995676%252Finterior_boot-1774700479484.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5676/19995676/interior_boot-1774700479484.jpg saved to cache
2026-03-29 20:26:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec44dd0>
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Finstrument_cluster-1774700447373.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/instrument_cluster-1774700447373.jpg saved to cache
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9592/20469592/docs_service_history-1774703503104.jpg?ixlib=js-3.8.0&auto=format&s=282d72da42dbc0798d76ac6f3166e3ca> (referer: None)
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0f110>
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9592%252F20469592%252Fdocs_service_history-1774703503104.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D282d72da42dbc0798d76ac6f3166e3ca') HTTP/1.1" 204 0
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9592/20469592/docs_service_history-1774703503104.jpg?ixlib=js-3.8.0&auto=format&s=282d72da42dbc0798d76ac6f3166e3ca saved to cache
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6438177.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9592/20469592/instrument_cluster-1774702466694.jpg> (referer: None)
2026-03-29 20:26:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.944(s), this was the 1st time calling it.
2026-03-29 20:26:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.888084049981651 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9592/20469592/interior_boot-1774702311660.jpg> (referer: None)
2026-03-29 20:26:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a9cc5a-de1b-542f-96db-7bd29ac01d12 with identifier: 6438177
2026-03-29 20:26:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12 with scrape type 1
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-exterior_front_driver-modified-1774630142054.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_driver-modified-1774630142054.jpeg not downloaded yet
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8177%252F6438177%252Fexterior_rear_driver-1759420609287.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_driver-1759420609287.jpeg not downloaded yet
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-exterior_front_passenger-modified-1774630155396.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_passenger-modified-1774630155396.jpeg not downloaded yet
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03c750>
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Finstrument_cluster-1774702466694.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/instrument_cluster-1774702466694.jpg saved to cache
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf4090>
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9592%252F20469592%252Finterior_boot-1774702311660.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9592/20469592/interior_boot-1774702311660.jpg saved to cache
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8177%252F6438177%252Fexterior_rear_passenger-1759420600763.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_passenger-1759420600763.jpeg not downloaded yet
2026-03-29 20:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8177%252F6438177%252Finterior_front_seats-1759420711671.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8177/6438177/interior_front_seats-1759420711671.jpeg not downloaded yet
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8177%252F6438177%252Finterior_rear_seats-1759420760375.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8177/6438177/interior_rear_seats-1759420760375.jpeg not downloaded yet
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-interior_dashboard-modified-1774630174111.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_dashboard-modified-1774630174111.jpeg not downloaded yet
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-interior_boot-modified-1774511465652.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_boot-modified-1774511465652.jpeg not downloaded yet
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F8177%252F6438177%252Fdocs_service_history-1759421644726.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49f3e9b39d428a359d7cf9c3b90a5d17%27 HTTP/1.1" 200 None
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644726.jpeg?ixlib=js-3.8.0&auto=format&s=49f3e9b39d428a359d7cf9c3b90a5d17 not downloaded yet
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F8177%252F6438177%252Fdocs_service_history-1759421644775.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7dd8eadbd33c9053b556adf8c05c16c5%27 HTTP/1.1" 200 None
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644775.jpeg?ixlib=js-3.8.0&auto=format&s=7dd8eadbd33c9053b556adf8c05c16c5 not downloaded yet
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9592/20469592/interior_dashboard-1774702345361.jpg> (referer: None)
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9592/20469592/interior_rear_seats-1774702323587.jpg> (referer: None)
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9592/20469592/interior_front_seats-1774702332193.jpg> (referer: None)
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644726.jpeg?ixlib=js-3.8.0&auto=format&s=49f3e9b39d428a359d7cf9c3b90a5d17> (referer: None)
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644775.jpeg?ixlib=js-3.8.0&auto=format&s=7dd8eadbd33c9053b556adf8c05c16c5> (referer: None)
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11fb90>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Finterior_dashboard-1774702345361.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/interior_dashboard-1774702345361.jpg saved to cache
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c26e2d0>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9592%252F20469592%252Finterior_rear_seats-1774702323587.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9592/20469592/interior_rear_seats-1774702323587.jpg saved to cache
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb5950>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9592%252F20469592%252Finterior_front_seats-1774702332193.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9592/20469592/interior_front_seats-1774702332193.jpg saved to cache
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec50b10>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F8177%252F6438177%252Fdocs_service_history-1759421644726.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49f3e9b39d428a359d7cf9c3b90a5d17') HTTP/1.1" 204 0
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644726.jpeg?ixlib=js-3.8.0&auto=format&s=49f3e9b39d428a359d7cf9c3b90a5d17 saved to cache
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c250c10>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F8177%252F6438177%252Fdocs_service_history-1759421644775.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7dd8eadbd33c9053b556adf8c05c16c5') HTTP/1.1" 204 0
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644775.jpeg?ixlib=js-3.8.0&auto=format&s=7dd8eadbd33c9053b556adf8c05c16c5 saved to cache
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_dashboard-modified-1774630174111.jpeg> (referer: None)
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_boot-modified-1774511465652.jpeg> (referer: None)
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2523d0>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-interior_dashboard-modified-1774630174111.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_dashboard-modified-1774630174111.jpeg saved to cache
2026-03-29 20:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7585646.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d784f50>
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-interior_boot-modified-1774511465652.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_boot-modified-1774511465652.jpeg saved to cache
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac5f319-fc36-55a2-9e68-acadf4880d93 with identifier: 7585646
2026-03-29 20:26:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac5f319-fc36-55a2-9e68-acadf4880d93 with scrape type 1
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_front_driver-1774617812560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_driver-1774617812560.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_rear_driver-1774617845037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_driver-1774617845037.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_front_passenger-1774617823257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_passenger-1774617823257.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_rear_passenger-1774617834018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_passenger-1774617834018.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Finterior_front_seats-1774617879862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/interior_front_seats-1774617879862.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Finterior_rear_seats-1774617930957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/interior_rear_seats-1774617930957.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5646%252F7585646%252F7585646-interior_dashboard-modified-1774619592420.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5646/7585646/7585646-interior_dashboard-modified-1774619592420.jpeg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Finterior_boot-1774617980789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/interior_boot-1774617980789.jpg not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5646%252F7585646%252Fdocs_service_history-1774618535088.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b668df10a0e5ac27e9683ceff1d1a58%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5646/7585646/docs_service_history-1774618535088.jpg?ixlib=js-3.8.0&auto=format&s=7b668df10a0e5ac27e9683ceff1d1a58 not downloaded yet
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Fdamage_scratches-1774618249031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/damage_scratches-1774618249031.jpg not downloaded yet
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_passenger-1759420600763.jpeg> (referer: None)
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_passenger-modified-1774630155396.jpeg> (referer: None)
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8177/6438177/interior_rear_seats-1759420760375.jpeg> (referer: None)
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8177/6438177/interior_front_seats-1759420711671.jpeg> (referer: None)
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d506190>
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8177%252F6438177%252Fexterior_rear_passenger-1759420600763.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_passenger-1759420600763.jpeg saved to cache
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d187ed0>
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-exterior_front_passenger-modified-1774630155396.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_passenger-modified-1774630155396.jpeg saved to cache
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:26:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:26:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\xaa\xdc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xec(\x00-\xa0\xca\x00\x00\x00\x00'
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e979910>
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8177%252F6438177%252Finterior_rear_seats-1759420760375.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8177/6438177/interior_rear_seats-1759420760375.jpeg saved to cache
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:26:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:26:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001/S\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xf9\xc2\x001%A\x00\x00\x00\x00'
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5c4d0>
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8177%252F6438177%252Finterior_front_seats-1759420711671.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8177/6438177/interior_front_seats-1759420711671.jpeg saved to cache
2026-03-29 20:26:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5646/7585646/docs_service_history-1774618535088.jpg?ixlib=js-3.8.0&auto=format&s=7b668df10a0e5ac27e9683ceff1d1a58> (referer: None)
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5646/7585646/damage_scratches-1774618249031.jpg> (referer: None)
2026-03-29 20:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5646/7585646/interior_rear_seats-1774617930957.jpg> (referer: None)
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e968310>
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5646%252F7585646%252Fdocs_service_history-1774618535088.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b668df10a0e5ac27e9683ceff1d1a58') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5646/7585646/docs_service_history-1774618535088.jpg?ixlib=js-3.8.0&auto=format&s=7b668df10a0e5ac27e9683ceff1d1a58 saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e929890>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Fdamage_scratches-1774618249031.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/damage_scratches-1774618249031.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e995950>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Finterior_rear_seats-1774617930957.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/interior_rear_seats-1774617930957.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5646/7585646/interior_front_seats-1774617879862.jpg> (referer: None)
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5646/7585646/interior_boot-1774617980789.jpg> (referer: None)
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5646/7585646/7585646-interior_dashboard-modified-1774619592420.jpeg> (referer: None)
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_passenger-1774617834018.jpg> (referer: None)
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54d4d0>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Finterior_front_seats-1774617879862.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/interior_front_seats-1774617879862.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e997690>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5646%252F7585646%252Finterior_boot-1774617980789.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5646/7585646/interior_boot-1774617980789.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d291d50>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5646%252F7585646%252F7585646-interior_dashboard-modified-1774619592420.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5646/7585646/7585646-interior_dashboard-modified-1774619592420.jpeg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ef110>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_rear_passenger-1774617834018.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_passenger-1774617834018.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_passenger-1774617823257.jpg> (referer: None)
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_driver-1774617845037.jpg> (referer: None)
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_driver-1774617812560.jpg> (referer: None)
2026-03-29 20:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_driver-1759420609287.jpeg> (referer: None)
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9a1d50>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_front_passenger-1774617823257.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_passenger-1774617823257.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d506a10>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_rear_driver-1774617845037.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_driver-1774617845037.jpg saved to cache
2026-03-29 20:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c4e50>
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5646%252F7585646%252Fexterior_front_driver-1774617812560.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_driver-1774617812560.jpg saved to cache
2026-03-29 20:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dac5f319-fc36-55a2-9e68-acadf4880d93
2026-03-29 20:26:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dac5f319-fc36-55a2-9e68-acadf4880d93, skipping ID generation
2026-03-29 20:26:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac5f319-fc36-55a2-9e68-acadf4880d93 with scrape type 1
2026-03-29 20:26:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dac5f319-fc36-55a2-9e68-acadf4880d93 sending to next pipeline
2026-03-29 20:26:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dac5f319-fc36-55a2-9e68-acadf4880d93, identifier: 7585646
2026-03-29 20:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54f190>
2026-03-29 20:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8177%252F6438177%252Fexterior_rear_driver-1759420609287.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_driver-1759420609287.jpeg saved to cache
2026-03-29 20:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dac5f319-fc36-55a2-9e68-acadf4880d93 with identifier: 7585646
2026-03-29 20:26:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dac5f319-fc36-55a2-9e68-acadf4880d93 with identifier: 7585646
2026-03-29 20:26:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dac5f319-fc36-55a2-9e68-acadf4880d93 with identifier: 7585646 to the API
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_driver-1774617812560.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'dac5f319-fc36-55a2-9e68-acadf4880d93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX18 NHK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7585646',
'listing': 'auction',
'location': 'County Durham Consett',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 29000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 887267,
'Height': 1745,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_driver-1774617812560.jpg',
'Width': 2327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 988256,
'Height': 2108,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_driver-1774617845037.jpg',
'Width': 2811},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762751,
'Height': 1778,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_front_passenger-1774617823257.jpg',
'Width': 2370},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703405,
'Height': 1773,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5646/7585646/exterior_rear_passenger-1774617834018.jpg',
'Width': 2364},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1264344,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5646/7585646/interior_front_seats-1774617879862.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1190406,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5646/7585646/interior_rear_seats-1774617930957.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1361449,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5646/7585646/7585646-interior_dashboard-modified-1774619592420.jpeg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1072186,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5646/7585646/interior_boot-1774617980789.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1001528,
'Height': 3264,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5646/7585646/docs_service_history-1774618535088.jpg?ixlib=js-3.8.0&auto=format&s=7b668df10a0e5ac27e9683ceff1d1a58',
'Width': 2448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dac5f319-fc36-55a2-9e68-acadf4880d93/dac5f319-fc36-55a2-9e68-acadf4880d93_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207499,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/5646/7585646/damage_scratches-1774618249031.jpg',
'Width': 3264}],
'price': 12688,
'price_includes_vat': False,
'registration_date': '2018-03-02',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque HSE DYN TD4 A',
'transmission': 'automatic',
'trim': 'Evoque HSE DYN TD4 A',
'vin': 'SALVA2AN2JH290391',
'year': 2018}
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277585646%27 HTTP/1.1" 200 None
2026-03-29 20:26:24 [motorway.uk] INFO: Saving data for 7585646: {'created_time': 1774815984.978892, 'last_price_update_time': 1774815984.978903, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7585646') HTTP/1.1" 204 0
2026-03-29 20:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_passenger-1774700133595.jpg> (referer: None)
2026-03-29 20:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_driver-modified-1774630142054.jpeg> (referer: None)
2026-03-29 20:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_driver-1774700194087.jpg> (referer: None)
2026-03-29 20:26:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_passenger-1774700015938.jpg> (referer: None)
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e3a50>
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_front_passenger-1774700133595.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_passenger-1774700133595.jpg saved to cache
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce97b10>
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8177%252F6438177%252F6438177-exterior_front_driver-modified-1774630142054.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_driver-modified-1774630142054.jpeg saved to cache
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12
2026-03-29 20:26:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96a9cc5a-de1b-542f-96db-7bd29ac01d12, skipping ID generation
2026-03-29 20:26:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12 with scrape type 1
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96a9cc5a-de1b-542f-96db-7bd29ac01d12 sending to next pipeline
2026-03-29 20:26:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 96a9cc5a-de1b-542f-96db-7bd29ac01d12, identifier: 6438177
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9e2a90>
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_rear_driver-1774700194087.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_driver-1774700194087.jpg saved to cache
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c5c50>
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_rear_passenger-1774700015938.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_passenger-1774700015938.jpg saved to cache
2026-03-29 20:26:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 96a9cc5a-de1b-542f-96db-7bd29ac01d12 with identifier: 6438177
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:26:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White+%26+Black HTTP/1.1" 200 None
2026-03-29 20:26:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:26:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 96a9cc5a-de1b-542f-96db-7bd29ac01d12 with identifier: 6438177
2026-03-29 20:26:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 96a9cc5a-de1b-542f-96db-7bd29ac01d12 with identifier: 6438177 to the API
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_driver-modified-1774630142054.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '96a9cc5a-de1b-542f-96db-7bd29ac01d12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ71 VSU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6438177',
'listing': 'auction',
'location': 'Southend-on-Sea Leigh-on-Sea',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 46500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2271101,
'Height': 3006,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_driver-modified-1774630142054.jpeg',
'Width': 4008},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1634022,
'Height': 2548,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_driver-1759420609287.jpeg',
'Width': 3397},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2537084,
'Height': 2840,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8177/6438177/6438177-exterior_front_passenger-modified-1774630155396.jpeg',
'Width': 3787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1469897,
'Height': 2449,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8177/6438177/exterior_rear_passenger-1759420600763.jpeg',
'Width': 3265},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3352853,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8177/6438177/interior_front_seats-1759420711671.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3118852,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8177/6438177/interior_rear_seats-1759420760375.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1427801,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_dashboard-modified-1774630174111.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1923298,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8177/6438177/6438177-interior_boot-modified-1774511465652.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224044,
'Height': 2796,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644726.jpeg?ixlib=js-3.8.0&auto=format&s=49f3e9b39d428a359d7cf9c3b90a5d17',
'Width': 1290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9cc5a-de1b-542f-96db-7bd29ac01d12/96a9cc5a-de1b-542f-96db-7bd29ac01d12_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259316,
'Height': 2796,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/8177/6438177/docs_service_history-1759421644775.jpeg?ixlib=js-3.8.0&auto=format&s=7dd8eadbd33c9053b556adf8c05c16c5',
'Width': 1290}],
'price': 24004,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seats_number': None,
'seller_name': None,
'title': 'Toyota RAV4 Dynamic HEV 4X2 CVT',
'transmission': 'automatic',
'trim': 'Dynamic HEV 4X2 CVT',
'vin': 'JTM253FV70J008413',
'year': 2022}
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276438177%27 HTTP/1.1" 200 None
2026-03-29 20:26:26 [motorway.uk] INFO: Saving data for 6438177: {'created_time': 1774815986.417381, 'last_price_update_time': 1774815986.417392, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6438177') HTTP/1.1" 204 0
2026-03-29 20:26:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:26:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_driver-1774700099737.jpg> (referer: None)
2026-03-29 20:26:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5676/19995676/interior_dashboard-1774700443338.jpg> (referer: None)
2026-03-29 20:26:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2edf90>
2026-03-29 20:26:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9592%252F20469592%252Fexterior_front_driver-1774700099737.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_driver-1774700099737.jpg saved to cache
2026-03-29 20:26:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b
2026-03-29 20:26:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b, skipping ID generation
2026-03-29 20:26:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b with scrape type 1
2026-03-29 20:26:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b sending to next pipeline
2026-03-29 20:26:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b, identifier: 20469592
2026-03-29 20:26:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b with identifier: 20469592
2026-03-29 20:26:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b with identifier: 20469592
2026-03-29 20:26:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b with identifier: 20469592 to the API
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_driver-1774700099737.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC20 CWD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20469592',
'listing': 'auction',
'location': 'None None',
'make': 'BMW',
'model': '1 Series',
'odometer': 33750,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849994,
'Height': 2784,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_driver-1774700099737.jpg',
'Width': 3712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2255324,
'Height': 2965,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_driver-1774700194087.jpg',
'Width': 3953},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1423642,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_front_passenger-1774700133595.jpg',
'Width': 3370},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2349325,
'Height': 2981,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9592/20469592/exterior_rear_passenger-1774700015938.jpg',
'Width': 3975},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2364497,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9592/20469592/interior_front_seats-1774702332193.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2159757,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9592/20469592/interior_rear_seats-1774702323587.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 966788,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9592/20469592/interior_dashboard-1774702345361.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1288992,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9592/20469592/instrument_cluster-1774702466694.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115383,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9592/20469592/interior_boot-1774702311660.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b/bec1ef09-1f7d-5638-a9fd-e0e1ebd0202b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3874739,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9592/20469592/docs_service_history-1774703503104.jpg?ixlib=js-3.8.0&auto=format&s=282d72da42dbc0798d76ac6f3166e3ca',
'Width': 4032}],
'price': 15078,
'price_includes_vat': False,
'registration_date': '2020-07-22',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I M Sport Auto',
'transmission': 'automatic',
'trim': '118I M Sport Auto',
'vin': 'WBA7K320905R04940',
'year': 2020}
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469592%27 HTTP/1.1" 200 None
2026-03-29 20:26:27 [motorway.uk] INFO: Saving data for 20469592: {'created_time': 1774815987.071031, 'last_price_update_time': 1774815987.071041, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20469592') HTTP/1.1" 204 0
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ed850>
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Finterior_dashboard-1774700443338.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/interior_dashboard-1774700443338.jpg saved to cache
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_passenger-1774699291145.jpg> (referer: None)
2026-03-29 20:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5676/19995676/interior_front_seats-1774701075505.jpg> (referer: None)
2026-03-29 20:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5676/19995676/interior_rear_seats-1774701113791.jpg> (referer: None)
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce14650>
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_rear_passenger-1774699291145.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_passenger-1774699291145.jpg saved to cache
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca49990>
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5676%252F19995676%252Finterior_front_seats-1774701075505.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5676/19995676/interior_front_seats-1774701075505.jpg saved to cache
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca4390>
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5676%252F19995676%252Finterior_rear_seats-1774701113791.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5676/19995676/interior_rear_seats-1774701113791.jpg saved to cache
2026-03-29 20:26:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_driver-1774699249334.jpg> (referer: None)
2026-03-29 20:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_passenger-1774699336727.jpg> (referer: None)
2026-03-29 20:26:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_driver-1774699200798.jpg> (referer: None)
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14309c10>
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_front_driver-1774699249334.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_driver-1774699249334.jpg saved to cache
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d54dd50>
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_front_passenger-1774699336727.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_passenger-1774699336727.jpg saved to cache
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d586650>
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5676%252F19995676%252Fexterior_rear_driver-1774699200798.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_driver-1774699200798.jpg saved to cache
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6c11d9c-0f45-55ef-ae58-6cd34218e371
2026-03-29 20:26:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6c11d9c-0f45-55ef-ae58-6cd34218e371, skipping ID generation
2026-03-29 20:26:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c11d9c-0f45-55ef-ae58-6cd34218e371 with scrape type 1
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6c11d9c-0f45-55ef-ae58-6cd34218e371 sending to next pipeline
2026-03-29 20:26:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d6c11d9c-0f45-55ef-ae58-6cd34218e371, identifier: 19995676
2026-03-29 20:26:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d6c11d9c-0f45-55ef-ae58-6cd34218e371 with identifier: 19995676
2026-03-29 20:26:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d6c11d9c-0f45-55ef-ae58-6cd34218e371 with identifier: 19995676
2026-03-29 20:26:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d6c11d9c-0f45-55ef-ae58-6cd34218e371 with identifier: 19995676 to the API
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_driver-1774699200798.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd6c11d9c-0f45-55ef-ae58-6cd34218e371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF20 JWC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19995676',
'listing': 'auction',
'location': 'West Midlands Willenhall',
'make': 'Mercedes',
'model': 'GLC',
'odometer': 66685,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1930951,
'Height': 2807,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_driver-1774699249334.jpg',
'Width': 3743},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1889735,
'Height': 2780,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_driver-1774699200798.jpg',
'Width': 3707},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928486,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_front_passenger-1774699336727.jpg',
'Width': 3371},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1676743,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5676/19995676/exterior_rear_passenger-1774699291145.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2781598,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5676/19995676/interior_front_seats-1774701075505.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4074178,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5676/19995676/interior_rear_seats-1774701113791.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3287029,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5676/19995676/interior_dashboard-1774700443338.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648153,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5676/19995676/instrument_cluster-1774700447373.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3385640,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5676/19995676/interior_boot-1774700479484.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c11d9c-0f45-55ef-ae58-6cd34218e371/d6c11d9c-0f45-55ef-ae58-6cd34218e371_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722324,
'Height': 3506,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5676/19995676/docs_service_history-1774702496671.jpg?ixlib=js-3.8.0&auto=format&s=cff4d20896766648b20f268c0bbf944d',
'Width': 2445}],
'price': 20003,
'price_includes_vat': False,
'registration_date': '2020-03-05',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLC 220 D 4M AMG Line Prem A',
'transmission': 'automatic',
'trim': '220 D 4M AMG Line Prem A',
'vin': 'W1N2539152F796666',
'year': 2020}
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719995676%27 HTTP/1.1" 200 None
2026-03-29 20:26:28 [motorway.uk] INFO: Saving data for 19995676: {'created_time': 1774815988.707743, 'last_price_update_time': 1774815988.707755, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19995676') HTTP/1.1" 204 0
2026-03-29 20:26:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9766/20309766/interior_boot-1774263840522.jpg> (referer: None)
2026-03-29 20:26:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9766/20309766/interior_dashboard-1774263829203.jpg> (referer: None)
2026-03-29 20:26:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9766/20309766/instrument_cluster-1774106256390.jpg> (referer: None)
2026-03-29 20:26:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9766/20309766/interior_rear_seats-1774106188137.jpg> (referer: None)
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d193f50>
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9766%252F20309766%252Finterior_boot-1774263840522.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9766/20309766/interior_boot-1774263840522.jpg saved to cache
2026-03-29 20:26:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d584750>
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9766%252F20309766%252Finterior_dashboard-1774263829203.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9766/20309766/interior_dashboard-1774263829203.jpg saved to cache
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c4890>
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Finstrument_cluster-1774106256390.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/instrument_cluster-1774106256390.jpg saved to cache
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d291fd0>
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9766%252F20309766%252Finterior_rear_seats-1774106188137.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9766/20309766/interior_rear_seats-1774106188137.jpg saved to cache
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19970268.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_passenger-1774105413966.jpg> (referer: None)
2026-03-29 20:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9766/20309766/interior_front_seats-1774106160849.jpg> (referer: None)
2026-03-29 20:26:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81528ba0-1473-5962-844d-0c00af893d61 with identifier: 19970268
2026-03-29 20:26:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81528ba0-1473-5962-844d-0c00af893d61 with scrape type 1
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_front_driver-1774699050412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_driver-1774699050412.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_rear_driver-1774699068542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_driver-1774699068542.jpg not downloaded yet
2026-03-29 20:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20375710.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_front_passenger-1774699092334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_passenger-1774699092334.jpg not downloaded yet
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb34d0>
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_rear_passenger-1774105413966.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_passenger-1774105413966.jpg saved to cache
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cade6d0>
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9766%252F20309766%252Finterior_front_seats-1774106160849.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9766/20309766/interior_front_seats-1774106160849.jpg saved to cache
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_rear_passenger-1774699080994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_passenger-1774699080994.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0268%252F19970268%252Finterior_front_seats-1774699297598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0268/19970268/interior_front_seats-1774699297598.jpg not downloaded yet
2026-03-29 20:26:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 with identifier: 20375710
2026-03-29 20:26:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 with scrape type 1
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_front_driver-1774447200615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_driver-1774447200615.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0268%252F19970268%252Finterior_rear_seats-1774699307856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0268/19970268/interior_rear_seats-1774699307856.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_rear_driver-1774447396226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_driver-1774447396226.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0268%252F19970268%252Finterior_dashboard-1774709982734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0268/19970268/interior_dashboard-1774709982734.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_front_passenger-1774447370279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_passenger-1774447370279.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Finstrument_cluster-1774699411520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/instrument_cluster-1774699411520.jpg not downloaded yet
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_rear_passenger-1774447348092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_passenger-1774447348092.jpg not downloaded yet
2026-03-29 20:26:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_passenger-1774105437003.jpg> (referer: None)
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0268%252F19970268%252Finterior_boot-1774699338411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0268/19970268/interior_boot-1774699338411.jpg not downloaded yet
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5710%252F20375710%252Finterior_front_seats-1774630023021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5710/20375710/interior_front_seats-1774630023021.jpg not downloaded yet
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0268%252F19970268%252Fdocs_service_history-1774700998737.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcd8c443f913c8b1ca01479c9fe677d8c%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0268/19970268/docs_service_history-1774700998737.jpg?ixlib=js-3.8.0&auto=format&s=cd8c443f913c8b1ca01479c9fe677d8c not downloaded yet
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5710%252F20375710%252Finterior_rear_seats-1774630149330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5710/20375710/interior_rear_seats-1774630149330.jpg not downloaded yet
2026-03-29 20:26:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_driver-1774105399301.jpg> (referer: None)
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Finterior_dashboard-1774630253737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/interior_dashboard-1774630253737.jpg not downloaded yet
2026-03-29 20:26:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_driver-1774105379321.jpg> (referer: None)
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5710%252F20375710%252Finterior_boot-1774629953660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5710/20375710/interior_boot-1774629953660.jpg not downloaded yet
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5710%252F20375710%252F20375710-docs_service_history-modified-1774695364844.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0015f87c47105b238f814a4a18c4c5e0%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5710/20375710/20375710-docs_service_history-modified-1774695364844.jpeg?ixlib=js-3.8.0&auto=format&s=0015f87c47105b238f814a4a18c4c5e0 not downloaded yet
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5bb90>
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_front_passenger-1774105437003.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_passenger-1774105437003.jpg saved to cache
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5710%252F20375710%252Fdocs_service_history-1774519627172-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29635442ed417b014e45a00c21cb7cf5%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5710/20375710/docs_service_history-1774519627172-2.jpeg?ixlib=js-3.8.0&auto=format&s=29635442ed417b014e45a00c21cb7cf5 not downloaded yet
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d0fd0>
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_rear_driver-1774105399301.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_driver-1774105399301.jpg saved to cache
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d0ed0>
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9766%252F20309766%252Fexterior_front_driver-1774105379321.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_driver-1774105379321.jpg saved to cache
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be60bede-1eae-5d2e-bab6-c76293157e21
2026-03-29 20:26:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be60bede-1eae-5d2e-bab6-c76293157e21, skipping ID generation
2026-03-29 20:26:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be60bede-1eae-5d2e-bab6-c76293157e21 with scrape type 1
2026-03-29 20:26:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be60bede-1eae-5d2e-bab6-c76293157e21 sending to next pipeline
2026-03-29 20:26:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: be60bede-1eae-5d2e-bab6-c76293157e21, identifier: 20309766
2026-03-29 20:26:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: be60bede-1eae-5d2e-bab6-c76293157e21 with identifier: 20309766
2026-03-29 20:26:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: be60bede-1eae-5d2e-bab6-c76293157e21 with identifier: 20309766
2026-03-29 20:26:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: be60bede-1eae-5d2e-bab6-c76293157e21 with identifier: 20309766 to the API
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_driver-1774105379321.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'be60bede-1eae-5d2e-bab6-c76293157e21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BL22 NKX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20309766',
'listing': 'auction',
'location': 'Leicestershire Coalville',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 50182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1728955,
'Height': 2640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_driver-1774105379321.jpg',
'Width': 3520},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1692835,
'Height': 2752,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_driver-1774105399301.jpg',
'Width': 3669},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1215382,
'Height': 2499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_front_passenger-1774105437003.jpg',
'Width': 3332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1440816,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9766/20309766/exterior_rear_passenger-1774105413966.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3912692,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9766/20309766/interior_front_seats-1774106160849.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3594619,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9766/20309766/interior_rear_seats-1774106188137.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657212,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9766/20309766/interior_dashboard-1774263829203.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3632776,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9766/20309766/instrument_cluster-1774106256390.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1900388,
'Height': 2352,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9766/20309766/interior_boot-1774263840522.jpg',
'Width': 3136},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be60bede-1eae-5d2e-bab6-c76293157e21/be60bede-1eae-5d2e-bab6-c76293157e21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296049,
'Height': 1700,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9766/20309766/docs_service_history-1774107168859.jpg?ixlib=js-3.8.0&auto=format&s=d5e41ebe0e29d593fe6f69a571f00750',
'Width': 1170}],
'price': 9990,
'price_includes_vat': False,
'registration_date': '2022-06-27',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa Ultimate Turbo Auto',
'transmission': 'automatic',
'trim': 'Ultimate Turbo Auto',
'vin': 'VXKUPHNSSN4260928',
'year': 2022}
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720309766%27 HTTP/1.1" 200 None
2026-03-29 20:26:30 [motorway.uk] INFO: Saving data for 20309766: {'created_time': 1774815990.914036, 'last_price_update_time': 1774815990.914046, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20309766') HTTP/1.1" 204 0
2026-03-29 20:26:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5710/20375710/docs_service_history-1774519627172-2.jpeg?ixlib=js-3.8.0&auto=format&s=29635442ed417b014e45a00c21cb7cf5> (referer: None)
2026-03-29 20:26:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_passenger-1774699092334.jpg> (referer: None)
2026-03-29 20:26:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_passenger-1774447348092.jpg> (referer: None)
2026-03-29 20:26:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5710/20375710/20375710-docs_service_history-modified-1774695364844.jpeg?ixlib=js-3.8.0&auto=format&s=0015f87c47105b238f814a4a18c4c5e0> (referer: None)
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_driver-1774699068542.jpg> (referer: None)
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f03b50>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5710%252F20375710%252Fdocs_service_history-1774519627172-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29635442ed417b014e45a00c21cb7cf5') HTTP/1.1" 204 0
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5710/20375710/docs_service_history-1774519627172-2.jpeg?ixlib=js-3.8.0&auto=format&s=29635442ed417b014e45a00c21cb7cf5 saved to cache
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce27250>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_front_passenger-1774699092334.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_passenger-1774699092334.jpg saved to cache
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c691e10>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_rear_passenger-1774447348092.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_passenger-1774447348092.jpg saved to cache
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d773250>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5710%252F20375710%252F20375710-docs_service_history-modified-1774695364844.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0015f87c47105b238f814a4a18c4c5e0') HTTP/1.1" 204 0
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5710/20375710/20375710-docs_service_history-modified-1774695364844.jpeg?ixlib=js-3.8.0&auto=format&s=0015f87c47105b238f814a4a18c4c5e0 saved to cache
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20386514.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07ecd0>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_rear_driver-1774699068542.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_driver-1774699068542.jpg saved to cache
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0268/19970268/docs_service_history-1774700998737.jpg?ixlib=js-3.8.0&auto=format&s=cd8c443f913c8b1ca01479c9fe677d8c> (referer: None)
2026-03-29 20:26:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeebe588-af70-578e-a548-e129805a99fb with identifier: 20386514
2026-03-29 20:26:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeebe588-af70-578e-a548-e129805a99fb with scrape type 1
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Fexterior_front_driver-1774782561223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/exterior_front_driver-1774782561223.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6514%252F20386514%252Fexterior_rear_driver-1774776271594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_rear_driver-1774776271594.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6514%252F20386514%252Fexterior_front_passenger-1774776267051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_front_passenger-1774776267051.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Fexterior_rear_passenger-1774782828314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/exterior_rear_passenger-1774782828314.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6514%252F20386514%252Finterior_front_seats-1774780393586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6514/20386514/interior_front_seats-1774780393586.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6514%252F20386514%252Finterior_rear_seats-1774780396138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6514/20386514/interior_rear_seats-1774780396138.jpg not downloaded yet
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce9d5d0>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0268%252F19970268%252Fdocs_service_history-1774700998737.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcd8c443f913c8b1ca01479c9fe677d8c') HTTP/1.1" 204 0
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0268/19970268/docs_service_history-1774700998737.jpg?ixlib=js-3.8.0&auto=format&s=cd8c443f913c8b1ca01479c9fe677d8c saved to cache
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Finterior_dashboard-1774782618735.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/interior_dashboard-1774782618735.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Finstrument_cluster-1774782632989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/instrument_cluster-1774782632989.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Finterior_boot-1774781844806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/interior_boot-1774781844806.jpg not downloaded yet
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6514%252F20386514%252Fdocs_service_history-1774781067970.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0bea1bb92cb3e13ce646c11856571d8c%27 HTTP/1.1" 200 None
2026-03-29 20:26:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6514/20386514/docs_service_history-1774781067970.jpg?ixlib=js-3.8.0&auto=format&s=0bea1bb92cb3e13ce646c11856571d8c not downloaded yet
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5710/20375710/interior_rear_seats-1774630149330.jpg> (referer: None)
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5710/20375710/interior_boot-1774629953660.jpg> (referer: None)
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5710/20375710/interior_dashboard-1774630253737.jpg> (referer: None)
2026-03-29 20:26:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0268/19970268/instrument_cluster-1774699411520.jpg> (referer: None)
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf5d0>
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5710%252F20375710%252Finterior_rear_seats-1774630149330.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5710/20375710/interior_rear_seats-1774630149330.jpg saved to cache
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5710/20375710/interior_front_seats-1774630023021.jpg> (referer: None)
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba8d90>
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5710%252F20375710%252Finterior_boot-1774629953660.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5710/20375710/interior_boot-1774629953660.jpg saved to cache
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21e2d0>
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Finterior_dashboard-1774630253737.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/interior_dashboard-1774630253737.jpg saved to cache
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21d050>
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Finstrument_cluster-1774699411520.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/instrument_cluster-1774699411520.jpg saved to cache
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c26e390>
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5710%252F20375710%252Finterior_front_seats-1774630023021.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5710/20375710/interior_front_seats-1774630023021.jpg saved to cache
2026-03-29 20:26:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6514/20386514/docs_service_history-1774781067970.jpg?ixlib=js-3.8.0&auto=format&s=0bea1bb92cb3e13ce646c11856571d8c> (referer: None)
2026-03-29 20:26:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0268/19970268/interior_boot-1774699338411.jpg> (referer: None)
2026-03-29 20:26:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6514/20386514/interior_rear_seats-1774780396138.jpg> (referer: None)
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9767d0>
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6514%252F20386514%252Fdocs_service_history-1774781067970.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0bea1bb92cb3e13ce646c11856571d8c') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6514/20386514/docs_service_history-1774781067970.jpg?ixlib=js-3.8.0&auto=format&s=0bea1bb92cb3e13ce646c11856571d8c saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2e6c50>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0268%252F19970268%252Finterior_boot-1774699338411.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0268/19970268/interior_boot-1774699338411.jpg saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec16010>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6514%252F20386514%252Finterior_rear_seats-1774780396138.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6514/20386514/interior_rear_seats-1774780396138.jpg saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6514/20386514/instrument_cluster-1774782632989.jpg> (referer: None)
2026-03-29 20:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6514/20386514/interior_front_seats-1774780393586.jpg> (referer: None)
2026-03-29 20:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6514/20386514/interior_boot-1774781844806.jpg> (referer: None)
2026-03-29 20:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6514/20386514/interior_dashboard-1774782618735.jpg> (referer: None)
2026-03-29 20:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6514/20386514/exterior_rear_passenger-1774782828314.jpg> (referer: None)
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebd4650>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Finstrument_cluster-1774782632989.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/instrument_cluster-1774782632989.jpg saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19886474.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c253c90>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6514%252F20386514%252Finterior_front_seats-1774780393586.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6514/20386514/interior_front_seats-1774780393586.jpg saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa7c50>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Finterior_boot-1774781844806.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/interior_boot-1774781844806.jpg saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119910>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Finterior_dashboard-1774782618735.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/interior_dashboard-1774782618735.jpg saved to cache
2026-03-29 20:26:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca27cd0>
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Fexterior_rear_passenger-1774782828314.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/exterior_rear_passenger-1774782828314.jpg saved to cache
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_front_passenger-1774776267051.jpg> (referer: None)
2026-03-29 20:26:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d575839-43b3-5d18-9f27-8399e74c647b with identifier: 19886474
2026-03-29 20:26:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d575839-43b3-5d18-9f27-8399e74c647b with scrape type 1
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_front_driver-1774506270316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_driver-1774506270316.jpg not downloaded yet
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_rear_driver-1774506303006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_driver-1774506303006.jpg not downloaded yet
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_front_passenger-1774506316712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_passenger-1774506316712.jpg not downloaded yet
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_rear_passenger-1774506306377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_passenger-1774506306377.jpg not downloaded yet
2026-03-29 20:26:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_rear_driver-1774776271594.jpg> (referer: None)
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6474%252F19886474%252Finterior_front_seats-1774506736256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6474/19886474/interior_front_seats-1774506736256.jpg not downloaded yet
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6474%252F19886474%252Finterior_rear_seats-1774506748073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6474/19886474/interior_rear_seats-1774506748073.jpg not downloaded yet
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Finterior_dashboard-1774506865403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/interior_dashboard-1774506865403.jpg not downloaded yet
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11a4d0>
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6514%252F20386514%252Fexterior_front_passenger-1774776267051.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_front_passenger-1774776267051.jpg saved to cache
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Finstrument_cluster-1774506822615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/instrument_cluster-1774506822615.jpg not downloaded yet
2026-03-29 20:26:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6514/20386514/exterior_front_driver-1774782561223.jpg> (referer: None)
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6474%252F19886474%252Finterior_boot-1774506789008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6474/19886474/interior_boot-1774506789008.jpg not downloaded yet
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14fbae50>
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6514%252F20386514%252Fexterior_rear_driver-1774776271594.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_rear_driver-1774776271594.jpg saved to cache
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6474%252F19886474%252Fdocs_service_history-1774506995123.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1d5aba499b2811d49ba2d684d4b4be9%27 HTTP/1.1" 200 None
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6474/19886474/docs_service_history-1774506995123.jpg?ixlib=js-3.8.0&auto=format&s=b1d5aba499b2811d49ba2d684d4b4be9 not downloaded yet
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24ce90>
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6514%252F20386514%252Fexterior_front_driver-1774782561223.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6514/20386514/exterior_front_driver-1774782561223.jpg saved to cache
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeebe588-af70-578e-a548-e129805a99fb
2026-03-29 20:26:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeebe588-af70-578e-a548-e129805a99fb, skipping ID generation
2026-03-29 20:26:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeebe588-af70-578e-a548-e129805a99fb with scrape type 1
2026-03-29 20:26:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeebe588-af70-578e-a548-e129805a99fb sending to next pipeline
2026-03-29 20:26:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aeebe588-af70-578e-a548-e129805a99fb, identifier: 20386514
2026-03-29 20:26:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_driver-1774447396226.jpg> (referer: None)
2026-03-29 20:26:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aeebe588-af70-578e-a548-e129805a99fb with identifier: 20386514
2026-03-29 20:26:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aeebe588-af70-578e-a548-e129805a99fb with identifier: 20386514
2026-03-29 20:26:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aeebe588-af70-578e-a548-e129805a99fb with identifier: 20386514 to the API
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6514/20386514/exterior_front_driver-1774782561223.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'aeebe588-af70-578e-a548-e129805a99fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VO66 YJS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20386514',
'listing': 'auction',
'location': 'Kent Ashford',
'make': 'Jaguar',
'model': 'XE Series',
'odometer': 31491,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1291770,
'Height': 2112,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6514/20386514/exterior_front_driver-1774782561223.jpg',
'Width': 2816},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392152,
'Height': 2422,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_rear_driver-1774776271594.jpg',
'Width': 3229},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1105683,
'Height': 2175,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6514/20386514/exterior_front_passenger-1774776267051.jpg',
'Width': 2900},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1608665,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6514/20386514/exterior_rear_passenger-1774782828314.jpg',
'Width': 3371},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041492,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6514/20386514/interior_front_seats-1774780393586.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580043,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6514/20386514/interior_rear_seats-1774780396138.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1393962,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6514/20386514/interior_dashboard-1774782618735.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1403769,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6514/20386514/instrument_cluster-1774782632989.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2015398,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6514/20386514/interior_boot-1774781844806.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeebe588-af70-578e-a548-e129805a99fb/aeebe588-af70-578e-a548-e129805a99fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1684618,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6514/20386514/docs_service_history-1774781067970.jpg?ixlib=js-3.8.0&auto=format&s=0bea1bb92cb3e13ce646c11856571d8c',
'Width': 3840}],
'price': 7336,
'price_includes_vat': False,
'registration_date': '2016-10-07',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE R-Sport D',
'transmission': 'manual',
'trim': 'XE R-Sport D',
'vin': 'SAJAB4CN5HCP02887',
'year': 2016}
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386514%27 HTTP/1.1" 200 None
2026-03-29 20:26:35 [motorway.uk] INFO: Saving data for 20386514: {'created_time': 1774815995.31467, 'last_price_update_time': 1774815995.314682, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20386514') HTTP/1.1" 204 0
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea45e50>
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_rear_driver-1774447396226.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_driver-1774447396226.jpg saved to cache
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_driver-1774447200615.jpg> (referer: None)
2026-03-29 20:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_passenger-1774506306377.jpg> (referer: None)
2026-03-29 20:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_passenger-1774447370279.jpg> (referer: None)
2026-03-29 20:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0268/19970268/interior_dashboard-1774709982734.jpg> (referer: None)
2026-03-29 20:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6474/19886474/instrument_cluster-1774506822615.jpg> (referer: None)
2026-03-29 20:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0268/19970268/interior_rear_seats-1774699307856.jpg> (referer: None)
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d016010>
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_front_driver-1774447200615.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_driver-1774447200615.jpg saved to cache
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f03c50>
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_rear_passenger-1774506306377.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_passenger-1774506306377.jpg saved to cache
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec2aa10>
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5710%252F20375710%252Fexterior_front_passenger-1774447370279.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_passenger-1774447370279.jpg saved to cache
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4
2026-03-29 20:26:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4, skipping ID generation
2026-03-29 20:26:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 with scrape type 1
2026-03-29 20:26:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 sending to next pipeline
2026-03-29 20:26:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4, identifier: 20375710
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1a890>
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0268%252F19970268%252Finterior_dashboard-1774709982734.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0268/19970268/interior_dashboard-1774709982734.jpg saved to cache
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea44990>
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Finstrument_cluster-1774506822615.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/instrument_cluster-1774506822615.jpg saved to cache
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01e10>
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0268%252F19970268%252Finterior_rear_seats-1774699307856.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0268/19970268/interior_rear_seats-1774699307856.jpg saved to cache
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 with identifier: 20375710
2026-03-29 20:26:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 with identifier: 20375710
2026-03-29 20:26:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4 with identifier: 20375710 to the API
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_passenger-1774447370279.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FT21 YWL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20375710',
'listing': 'auction',
'location': 'Herefordshire Ross-on-Wye',
'make': 'Ford',
'model': 'Kuga',
'odometer': 33900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375006,
'Height': 2315,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_driver-1774447200615.jpg',
'Width': 3086},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710017,
'Height': 1739,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_driver-1774447396226.jpg',
'Width': 2318},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1914581,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_front_passenger-1774447370279.jpg',
'Width': 3434},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1791336,
'Height': 2595,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5710/20375710/exterior_rear_passenger-1774447348092.jpg',
'Width': 3460},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3574429,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5710/20375710/interior_front_seats-1774630023021.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3358018,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5710/20375710/interior_rear_seats-1774630149330.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3529465,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5710/20375710/interior_dashboard-1774630253737.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3605019,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5710/20375710/interior_boot-1774629953660.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124064,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5710/20375710/20375710-docs_service_history-modified-1774695364844.jpeg?ixlib=js-3.8.0&auto=format&s=0015f87c47105b238f814a4a18c4c5e0',
'Width': 947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4/6f98b6b4-7a5c-5d61-b92b-bcbbf870f8d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60069,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5710/20375710/docs_service_history-1774519627172-2.jpeg?ixlib=js-3.8.0&auto=format&s=29635442ed417b014e45a00c21cb7cf5',
'Width': 892}],
'price': 14411,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga Titanium Frst ED PHEV CVT',
'transmission': 'automatic',
'trim': 'Titanium Frst ED PHEV CVT',
'vin': 'WF0FXXWPMHLR85058',
'year': 2021}
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720375710%27 HTTP/1.1" 200 None
2026-03-29 20:26:36 [motorway.uk] INFO: Saving data for 20375710: {'created_time': 1774815996.653138, 'last_price_update_time': 1774815996.653148, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20375710') HTTP/1.1" 204 0
2026-03-29 20:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6474/19886474/docs_service_history-1774506995123.jpg?ixlib=js-3.8.0&auto=format&s=b1d5aba499b2811d49ba2d684d4b4be9> (referer: None)
2026-03-29 20:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6474/19886474/interior_dashboard-1774506865403.jpg> (referer: None)
2026-03-29 20:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6474/19886474/interior_rear_seats-1774506748073.jpg> (referer: None)
2026-03-29 20:26:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6474/19886474/interior_boot-1774506789008.jpg> (referer: None)
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24a850>
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6474%252F19886474%252Fdocs_service_history-1774506995123.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1d5aba499b2811d49ba2d684d4b4be9') HTTP/1.1" 204 0
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6474/19886474/docs_service_history-1774506995123.jpg?ixlib=js-3.8.0&auto=format&s=b1d5aba499b2811d49ba2d684d4b4be9 saved to cache
2026-03-29 20:26:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edbb850>
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Finterior_dashboard-1774506865403.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/interior_dashboard-1774506865403.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce24c50>
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6474%252F19886474%252Finterior_rear_seats-1774506748073.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6474/19886474/interior_rear_seats-1774506748073.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cefe950>
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6474%252F19886474%252Finterior_boot-1774506789008.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6474/19886474/interior_boot-1774506789008.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_passenger-1774506316712.jpg> (referer: None)
2026-03-29 20:26:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_driver-1774506270316.jpg> (referer: None)
2026-03-29 20:26:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_driver-1774506303006.jpg> (referer: None)
2026-03-29 20:26:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6474/19886474/interior_front_seats-1774506736256.jpg> (referer: None)
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c648190>
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_front_passenger-1774506316712.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_passenger-1774506316712.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea65f90>
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_front_driver-1774506270316.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_driver-1774506270316.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95c890>
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6474%252F19886474%252Fexterior_rear_driver-1774506303006.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_driver-1774506303006.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca19d50>
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6474%252F19886474%252Finterior_front_seats-1774506736256.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6474/19886474/interior_front_seats-1774506736256.jpg saved to cache
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d575839-43b3-5d18-9f27-8399e74c647b
2026-03-29 20:26:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d575839-43b3-5d18-9f27-8399e74c647b, skipping ID generation
2026-03-29 20:26:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d575839-43b3-5d18-9f27-8399e74c647b with scrape type 1
2026-03-29 20:26:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d575839-43b3-5d18-9f27-8399e74c647b sending to next pipeline
2026-03-29 20:26:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1d575839-43b3-5d18-9f27-8399e74c647b, identifier: 19886474
2026-03-29 20:26:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1d575839-43b3-5d18-9f27-8399e74c647b with identifier: 19886474
2026-03-29 20:26:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1d575839-43b3-5d18-9f27-8399e74c647b with identifier: 19886474
2026-03-29 20:26:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1d575839-43b3-5d18-9f27-8399e74c647b with identifier: 19886474 to the API
2026-03-29 20:26:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6474/19886474/interior_front_seats-1774506736256.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1d575839-43b3-5d18-9f27-8399e74c647b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T555 ROD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19886474',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'MINI',
'model': 'Clubman',
'odometer': 22000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1457727,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_driver-1774506270316.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1668956,
'Height': 2563,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_driver-1774506303006.jpg',
'Width': 3417},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1227181,
'Height': 2049,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_front_passenger-1774506316712.jpg',
'Width': 2732},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1248794,
'Height': 2267,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6474/19886474/exterior_rear_passenger-1774506306377.jpg',
'Width': 3023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3044800,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6474/19886474/interior_front_seats-1774506736256.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2750708,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6474/19886474/interior_rear_seats-1774506748073.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517827,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6474/19886474/interior_dashboard-1774506865403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2174929,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6474/19886474/instrument_cluster-1774506822615.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3504829,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6474/19886474/interior_boot-1774506789008.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d575839-43b3-5d18-9f27-8399e74c647b/1d575839-43b3-5d18-9f27-8399e74c647b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1235102,
'Height': 4278,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6474/19886474/docs_service_history-1774506995123.jpg?ixlib=js-3.8.0&auto=format&s=b1d5aba499b2811d49ba2d684d4b4be9',
'Width': 2826}],
'price': 21838,
'price_includes_vat': False,
'registration_date': '2020-12-21',
'seats_number': None,
'seller_name': None,
'title': 'MINI Clubman John Cooper Works A4 A',
'transmission': 'automatic',
'trim': 'John Cooper Works A4 A',
'vin': 'WMWJZ920402P23640',
'year': 2020}
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719886474%27 HTTP/1.1" 200 None
2026-03-29 20:26:38 [motorway.uk] INFO: Saving data for 19886474: {'created_time': 1774815998.206875, 'last_price_update_time': 1774815998.206887, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19886474') HTTP/1.1" 204 0
2026-03-29 20:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20470703.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=936&page=26&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0268/19970268/interior_front_seats-1774699297598.jpg> (referer: None)
2026-03-29 20:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_driver-1774699050412.jpg> (referer: None)
2026-03-29 20:26:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_passenger-1774699080994.jpg> (referer: None)
2026-03-29 20:26:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fad4611a-c624-57db-a258-dd1855d4a417 with identifier: 20470703
2026-03-29 20:26:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fad4611a-c624-57db-a258-dd1855d4a417 with scrape type 1
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_front_driver-1774692748618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_driver-1774692748618.jpg not downloaded yet
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_rear_driver-1774692744004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_driver-1774692744004.jpg not downloaded yet
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_front_passenger-1774692757490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_passenger-1774692757490.jpg not downloaded yet
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 8035510
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 20487217
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 9709671
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 18815814
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 20223018
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 20483589
2026-03-29 20:26:38 [motorway.uk] INFO: Found listing with ID: 12179919
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712179919%27 HTTP/1.1" 200 None
2026-03-29 20:26:38 [motorway.uk] INFO: Scrape type for 12179919: 1
2026-03-29 20:26:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca5d390>
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0268%252F19970268%252Finterior_front_seats-1774699297598.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0268/19970268/interior_front_seats-1774699297598.jpg saved to cache
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28f890>
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_front_driver-1774699050412.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_driver-1774699050412.jpg saved to cache
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e092710>
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0268%252F19970268%252Fexterior_rear_passenger-1774699080994.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_passenger-1774699080994.jpg saved to cache
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81528ba0-1473-5962-844d-0c00af893d61
2026-03-29 20:26:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81528ba0-1473-5962-844d-0c00af893d61, skipping ID generation
2026-03-29 20:26:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81528ba0-1473-5962-844d-0c00af893d61 with scrape type 1
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81528ba0-1473-5962-844d-0c00af893d61 sending to next pipeline
2026-03-29 20:26:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 81528ba0-1473-5962-844d-0c00af893d61, identifier: 19970268
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_rear_passenger-1774692742114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_passenger-1774692742114.jpg not downloaded yet
2026-03-29 20:26:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 81528ba0-1473-5962-844d-0c00af893d61 with identifier: 19970268
2026-03-29 20:26:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 81528ba0-1473-5962-844d-0c00af893d61 with identifier: 19970268
2026-03-29 20:26:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 81528ba0-1473-5962-844d-0c00af893d61 with identifier: 19970268 to the API
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_passenger-1774699080994.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '81528ba0-1473-5962-844d-0c00af893d61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EK71 FJD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19970268',
'listing': 'auction',
'location': 'Essex Billericay',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 58347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1500217,
'Height': 2306,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_driver-1774699050412.jpg',
'Width': 3074},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612298,
'Height': 2323,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_driver-1774699068542.jpg',
'Width': 3097},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801613,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_front_passenger-1774699092334.jpg',
'Width': 3226},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1577747,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0268/19970268/exterior_rear_passenger-1774699080994.jpg',
'Width': 3190},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4592785,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0268/19970268/interior_front_seats-1774699297598.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3563630,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0268/19970268/interior_rear_seats-1774699307856.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2524034,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0268/19970268/interior_dashboard-1774709982734.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2771235,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0268/19970268/instrument_cluster-1774699411520.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4708779,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0268/19970268/interior_boot-1774699338411.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81528ba0-1473-5962-844d-0c00af893d61/81528ba0-1473-5962-844d-0c00af893d61_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1935047,
'Height': 1623,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0268/19970268/docs_service_history-1774700998737.jpg?ixlib=js-3.8.0&auto=format&s=cd8c443f913c8b1ca01479c9fe677d8c',
'Width': 2187}],
'price': 7077,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa Griffin',
'transmission': 'manual',
'trim': 'Griffin',
'vin': 'VXKUPHMHDM4291028',
'year': 2021}
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719970268%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Saving data for 19970268: {'created_time': 1774815999.332948, 'last_price_update_time': 1774815999.332962, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19970268') HTTP/1.1" 204 0
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20468816
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20377393
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720377393%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 20377393: 1
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F20470703%252Finterior_front_seats-1774693301437.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/20470703/interior_front_seats-1774693301437.jpg not downloaded yet
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 17155088
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20267868
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 3064694
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273064694%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 3064694: 1
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F20470703%252Finterior_rear_seats-1774693297996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/20470703/interior_rear_seats-1774693297996.jpg not downloaded yet
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 19938092
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20502804
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720502804%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 20502804: 1
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0703%252F20470703%252Finterior_dashboard-1774694703285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0703/20470703/interior_dashboard-1774694703285.jpg not downloaded yet
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 19713153
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 19838319
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20050031
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 16344729
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20490281
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490281%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 20490281: 1
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F20470703%252Finterior_boot-1774693291150.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/20470703/interior_boot-1774693291150.jpg not downloaded yet
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 16868488
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 19871523
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719871523%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 19871523: 1
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F20470703%252Fdocs_service_history-1774694940725.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6194bb3165fc90853793f9b623a6e71f%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694940725.jpg?ixlib=js-3.8.0&auto=format&s=6194bb3165fc90853793f9b623a6e71f not downloaded yet
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20412314
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720412314%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 20412314: 1
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F20470703%252Fdocs_service_history-1774694957984.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9561e13722ddba1b71d2ed2046c43509%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694957984.jpg?ixlib=js-3.8.0&auto=format&s=9561e13722ddba1b71d2ed2046c43509 not downloaded yet
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20415492
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 17316820
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717316820%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 17316820: 1
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20175981
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20453641
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20478408
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20469298
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469298%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 20469298: 1
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20319525
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 16548854
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716548854%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 16548854: 1
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20052855
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720052855%27 HTTP/1.1" 200 None
2026-03-29 20:26:39 [motorway.uk] INFO: Scrape type for 20052855: 1
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20374311
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 17186648
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 17160787
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20384196
2026-03-29 20:26:39 [motorway.uk] INFO: Found listing with ID: 20037779
2026-03-29 20:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_passenger-1774692742114.jpg> (referer: None)
2026-03-29 20:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_passenger-1774692757490.jpg> (referer: None)
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce75550>
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_rear_passenger-1774692742114.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_passenger-1774692742114.jpg saved to cache
2026-03-29 20:26:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0dad0>
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_front_passenger-1774692757490.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_passenger-1774692757490.jpg saved to cache
2026-03-29 20:26:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:26:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20441111.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 with identifier: 20441111
2026-03-29 20:26:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 with scrape type 1
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_front_driver-1774696059708.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_driver-1774696059708.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_rear_driver-1774696098017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_driver-1774696098017.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_front_passenger-1774696130881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_passenger-1774696130881.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_rear_passenger-1774696113605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_passenger-1774696113605.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1111%252F20441111%252Finterior_front_seats-1774696812865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1111/20441111/interior_front_seats-1774696812865.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1111%252F20441111%252Finterior_rear_seats-1774696856200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1111/20441111/interior_rear_seats-1774696856200.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Finterior_dashboard-1774697010588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/interior_dashboard-1774697010588.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Finstrument_cluster-1774696850131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/instrument_cluster-1774696850131.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1111%252F20441111%252Finterior_boot-1774697072255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1111/20441111/interior_boot-1774697072255.jpg not downloaded yet
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1111%252F20441111%252Fdocs_service_history-1774699047990.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D80d70b0a1079eeb3d19ff9a0f78d5a9e%27 HTTP/1.1" 200 None
2026-03-29 20:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1111/20441111/docs_service_history-1774699047990.jpg?ixlib=js-3.8.0&auto=format&s=80d70b0a1079eeb3d19ff9a0f78d5a9e not downloaded yet
2026-03-29 20:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20450033.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 with identifier: 20450033
2026-03-29 20:26:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 with scrape type 1
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F20450033%252Fexterior_front_driver-1774694382244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/20450033/exterior_front_driver-1774694382244.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F20450033%252Fexterior_rear_driver-1774694404037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/20450033/exterior_rear_driver-1774694404037.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0033%252F20450033%252Fexterior_front_passenger-1774690555657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_front_passenger-1774690555657.jpg not downloaded yet
2026-03-29 20:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19430237.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0033%252F20450033%252Fexterior_rear_passenger-1774690557201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_rear_passenger-1774690557201.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F20450033%252Finterior_front_seats-1774691362214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/20450033/interior_front_seats-1774691362214.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F20450033%252Finterior_rear_seats-1774691380254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/20450033/interior_rear_seats-1774691380254.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F20450033%252Finterior_dashboard-1774694795521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/20450033/interior_dashboard-1774694795521.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0033%252F20450033%252Finstrument_cluster-1774691459362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0033/20450033/instrument_cluster-1774691459362.jpg not downloaded yet
2026-03-29 20:26:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1111/20441111/docs_service_history-1774699047990.jpg?ixlib=js-3.8.0&auto=format&s=80d70b0a1079eeb3d19ff9a0f78d5a9e> (referer: None)
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F20450033%252Finterior_boot-1774691427109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/20450033/interior_boot-1774691427109.jpg not downloaded yet
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0033%252F20450033%252Fdocs_service_history-1774692351364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D14d129b69005998a09f5735d494738fe%27 HTTP/1.1" 200 None
2026-03-29 20:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/20450033/docs_service_history-1774692351364.jpg?ixlib=js-3.8.0&auto=format&s=14d129b69005998a09f5735d494738fe not downloaded yet
2026-03-29 20:26:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb966837-13b9-53cc-be7e-fc0ee0ecb361 with identifier: 19430237
2026-03-29 20:26:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb966837-13b9-53cc-be7e-fc0ee0ecb361 with scrape type 2
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb966837-13b9-53cc-be7e-fc0ee0ecb361 with scrape type 2
2026-03-29 20:26:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cb966837-13b9-53cc-be7e-fc0ee0ecb361, identifier: 19430237
2026-03-29 20:26:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cb966837-13b9-53cc-be7e-fc0ee0ecb361 with identifier: 19430237
2026-03-29 20:26:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cb966837-13b9-53cc-be7e-fc0ee0ecb361 with identifier: 19430237
2026-03-29 20:26:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cb966837-13b9-53cc-be7e-fc0ee0ecb361 with identifier: 19430237 to the API
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19430237.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cb966837-13b9-53cc-be7e-fc0ee0ecb361',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BC19 NXE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19430237',
'listing': 'auction',
'location': 'Lancashire Chorley',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 55050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 13813,
'price_includes_vat': False,
'registration_date': '2019-05-23',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport Landmark TD4 A',
'transmission': 'automatic',
'trim': 'Sport Landmark TD4 A',
'vin': 'SALCA2AN4KH825701',
'year': 2019}
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719430237%27 HTTP/1.1" 200 None
2026-03-29 20:26:44 [motorway.uk] INFO: Saving data for 19430237: {'auction_closing_time': 1774884600.0, 'created_time': 1774728999.136947, 'last_price_update_time': 1774816004.481683}
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19430237') HTTP/1.1" 204 0
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea67dd0>
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1111%252F20441111%252Fdocs_service_history-1774699047990.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D80d70b0a1079eeb3d19ff9a0f78d5a9e') HTTP/1.1" 204 0
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1111/20441111/docs_service_history-1774699047990.jpg?ixlib=js-3.8.0&auto=format&s=80d70b0a1079eeb3d19ff9a0f78d5a9e saved to cache
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0033/20450033/instrument_cluster-1774691459362.jpg> (referer: None)
2026-03-29 20:26:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/20450033/exterior_rear_driver-1774694404037.jpg> (referer: None)
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d017890>
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0033%252F20450033%252Finstrument_cluster-1774691459362.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0033/20450033/instrument_cluster-1774691459362.jpg saved to cache
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01910>
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F20450033%252Fexterior_rear_driver-1774694404037.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/20450033/exterior_rear_driver-1774694404037.jpg saved to cache
2026-03-29 20:26:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/20450033/docs_service_history-1774692351364.jpg?ixlib=js-3.8.0&auto=format&s=14d129b69005998a09f5735d494738fe> (referer: None)
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d33e6d0>
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0033%252F20450033%252Fdocs_service_history-1774692351364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D14d129b69005998a09f5735d494738fe') HTTP/1.1" 204 0
2026-03-29 20:26:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/20450033/docs_service_history-1774692351364.jpg?ixlib=js-3.8.0&auto=format&s=14d129b69005998a09f5735d494738fe saved to cache
2026-03-29 20:26:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/20450033/interior_dashboard-1774694795521.jpg> (referer: None)
2026-03-29 20:26:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0033/20450033/interior_boot-1774691427109.jpg> (referer: None)
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb5750>
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F20450033%252Finterior_dashboard-1774694795521.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/20450033/interior_dashboard-1774694795521.jpg saved to cache
2026-03-29 20:26:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d78a950>
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F20450033%252Finterior_boot-1774691427109.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/20450033/interior_boot-1774691427109.jpg saved to cache
2026-03-29 20:26:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0033/20450033/interior_rear_seats-1774691380254.jpg> (referer: None)
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb6810>
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F20450033%252Finterior_rear_seats-1774691380254.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/20450033/interior_rear_seats-1774691380254.jpg saved to cache
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0033/20450033/interior_front_seats-1774691362214.jpg> (referer: None)
2026-03-29 20:26:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_rear_passenger-1774690557201.jpg> (referer: None)
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d016290>
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0033%252F20450033%252Finterior_front_seats-1774691362214.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0033/20450033/interior_front_seats-1774691362214.jpg saved to cache
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d789e10>
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0033%252F20450033%252Fexterior_rear_passenger-1774690557201.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_rear_passenger-1774690557201.jpg saved to cache
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_front_passenger-1774690555657.jpg> (referer: None)
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d014e90>
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0033%252F20450033%252Fexterior_front_passenger-1774690555657.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_front_passenger-1774690555657.jpg saved to cache
2026-03-29 20:26:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0033/20450033/exterior_front_driver-1774694382244.jpg> (referer: None)
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d78a950>
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0033%252F20450033%252Fexterior_front_driver-1774694382244.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0033/20450033/exterior_front_driver-1774694382244.jpg saved to cache
2026-03-29 20:26:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556
2026-03-29 20:26:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556, skipping ID generation
2026-03-29 20:26:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 with scrape type 1
2026-03-29 20:26:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 sending to next pipeline
2026-03-29 20:26:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556, identifier: 20450033
2026-03-29 20:26:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 with identifier: 20450033
2026-03-29 20:26:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 with identifier: 20450033
2026-03-29 20:26:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9c9da9b7-b8d0-571f-83eb-15ad4d1b7556 with identifier: 20450033 to the API
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0033/20450033/exterior_front_driver-1774694382244.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9c9da9b7-b8d0-571f-83eb-15ad4d1b7556',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MV19 PWL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20450033',
'listing': 'auction',
'location': 'Warrington Warrington',
'make': 'Jaguar',
'model': 'XE Series',
'odometer': 56180,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2609309,
'Height': 2662,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/20450033/exterior_front_driver-1774694382244.jpg',
'Width': 3549},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2986025,
'Height': 2833,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/20450033/exterior_rear_driver-1774694404037.jpg',
'Width': 3777},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2168743,
'Height': 2557,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_front_passenger-1774690555657.jpg',
'Width': 3409},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443341,
'Height': 2665,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0033/20450033/exterior_rear_passenger-1774690557201.jpg',
'Width': 3553},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3993276,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0033/20450033/interior_front_seats-1774691362214.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3848222,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0033/20450033/interior_rear_seats-1774691380254.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2380595,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0033/20450033/interior_dashboard-1774694795521.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2422750,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0033/20450033/instrument_cluster-1774691459362.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3936032,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0033/20450033/interior_boot-1774691427109.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9da9b7-b8d0-571f-83eb-15ad4d1b7556/9c9da9b7-b8d0-571f-83eb-15ad4d1b7556_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 569042,
'Height': 3047,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0033/20450033/docs_service_history-1774692351364.jpg?ixlib=js-3.8.0&auto=format&s=14d129b69005998a09f5735d494738fe',
'Width': 2143}],
'price': 9798,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE R-Sport Auto',
'transmission': 'automatic',
'trim': 'XE R-Sport Auto',
'vin': 'SAJAB4AX5KCP52457',
'year': 2019}
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450033%27 HTTP/1.1" 200 None
2026-03-29 20:26:47 [motorway.uk] INFO: Saving data for 20450033: {'created_time': 1774816007.792801, 'last_price_update_time': 1774816007.792813, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20450033') HTTP/1.1" 204 0
2026-03-29 20:26:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1111/20441111/instrument_cluster-1774696850131.jpg> (referer: None)
2026-03-29 20:26:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1111/20441111/interior_boot-1774697072255.jpg> (referer: None)
2026-03-29 20:26:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5b190>
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Finstrument_cluster-1774696850131.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/instrument_cluster-1774696850131.jpg saved to cache
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483472.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d789d50>
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1111%252F20441111%252Finterior_boot-1774697072255.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1111/20441111/interior_boot-1774697072255.jpg saved to cache
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c715d2-c605-5703-b12b-32655ea2eae6 with identifier: 20483472
2026-03-29 20:26:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c715d2-c605-5703-b12b-32655ea2eae6 with scrape type 1
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_front_driver-1774776063377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_driver-1774776063377.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_rear_driver-1774776960451.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_driver-1774776960451.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_front_passenger-1774776075785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_passenger-1774776075785.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_rear_passenger-1774776072103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_passenger-1774776072103.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3472%252F20483472%252Finterior_front_seats-1774776424898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3472/20483472/interior_front_seats-1774776424898.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3472%252F20483472%252Finterior_rear_seats-1774776424189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3472/20483472/interior_rear_seats-1774776424189.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Finterior_dashboard-1774776443251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/interior_dashboard-1774776443251.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Finstrument_cluster-1774776560139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/instrument_cluster-1774776560139.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3472%252F20483472%252Finterior_boot-1774776427515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3472/20483472/interior_boot-1774776427515.jpg not downloaded yet
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3472%252F20483472%252Fdocs_service_history-1774776649198.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D87470e4568c2d874ff77b57a753c8eae%27 HTTP/1.1" 200 None
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3472/20483472/docs_service_history-1774776649198.jpg?ixlib=js-3.8.0&auto=format&s=87470e4568c2d874ff77b57a753c8eae not downloaded yet
2026-03-29 20:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1111/20441111/interior_dashboard-1774697010588.jpg> (referer: None)
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119050>
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Finterior_dashboard-1774697010588.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/interior_dashboard-1774697010588.jpg saved to cache
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1111/20441111/interior_rear_seats-1774696856200.jpg> (referer: None)
2026-03-29 20:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3472/20483472/docs_service_history-1774776649198.jpg?ixlib=js-3.8.0&auto=format&s=87470e4568c2d874ff77b57a753c8eae> (referer: None)
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb38850>
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1111%252F20441111%252Finterior_rear_seats-1774696856200.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1111/20441111/interior_rear_seats-1774696856200.jpg saved to cache
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20168276.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa4410>
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3472%252F20483472%252Fdocs_service_history-1774776649198.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D87470e4568c2d874ff77b57a753c8eae') HTTP/1.1" 204 0
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3472/20483472/docs_service_history-1774776649198.jpg?ixlib=js-3.8.0&auto=format&s=87470e4568c2d874ff77b57a753c8eae saved to cache
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1111/20441111/interior_front_seats-1774696812865.jpg> (referer: None)
2026-03-29 20:26:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0b1710-bb4f-52af-91bf-bb344dfc791c with identifier: 20168276
2026-03-29 20:26:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0b1710-bb4f-52af-91bf-bb344dfc791c with scrape type 1
2026-03-29 20:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb0b1710-bb4f-52af-91bf-bb344dfc791c
2026-03-29 20:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8276%252F20168276%252Fexterior_front_driver-1773243602973.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_front_driver-1773243602973.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8276%252F20168276%252Fexterior_rear_driver-1773243536938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_rear_driver-1773243536938.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8276%252F20168276%252Fexterior_front_passenger-1773243593399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_front_passenger-1773243593399.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8276%252F20168276%252Fexterior_rear_passenger-1773243565972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_rear_passenger-1773243565972.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8276%252F20168276%252Finterior_front_seats-1773243881361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8276/20168276/interior_front_seats-1773243881361.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8276%252F20168276%252Finterior_rear_seats-1773243928941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8276/20168276/interior_rear_seats-1773243928941.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8276%252F20168276%252Finterior_dashboard-1773504707908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8276/20168276/interior_dashboard-1773504707908.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8276%252F20168276%252Finstrument_cluster-1773244254309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8276/20168276/instrument_cluster-1773244254309.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8276%252F20168276%252Finterior_boot-1773243998025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8276/20168276/interior_boot-1773243998025.jpg already downloaded
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8276%252F20168276%252Fdocs_service_history-1773257599615.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e8759a26123c1f84375f809c3274c5c%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8276/20168276/docs_service_history-1773257599615.jpg?ixlib=js-3.8.0&auto=format&s=5e8759a26123c1f84375f809c3274c5c already downloaded
2026-03-29 20:26:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fb0b1710-bb4f-52af-91bf-bb344dfc791c, identifier: 20168276
2026-03-29 20:26:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fb0b1710-bb4f-52af-91bf-bb344dfc791c with identifier: 20168276
2026-03-29 20:26:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fb0b1710-bb4f-52af-91bf-bb344dfc791c with identifier: 20168276
2026-03-29 20:26:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fb0b1710-bb4f-52af-91bf-bb344dfc791c with identifier: 20168276 to the API
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20168276.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'fb0b1710-bb4f-52af-91bf-bb344dfc791c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YP74 FHF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20168276',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Kia',
'model': 'Sportage',
'odometer': 5650,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_front_driver-1773243602973.jpg',
'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_rear_driver-1773243536938.jpg',
'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_front_passenger-1773243593399.jpg',
'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_rear_passenger-1773243565972.jpg',
'https://motorway-photos.imgix.net/8276/20168276/interior_front_seats-1773243881361.jpg',
'https://motorway-photos.imgix.net/8276/20168276/interior_rear_seats-1773243928941.jpg',
'https://motorway-photos-modified.imgix.net/8276/20168276/interior_dashboard-1773504707908.jpg',
'https://motorway-photos-redacted.imgix.net/8276/20168276/instrument_cluster-1773244254309.jpg',
'https://motorway-photos.imgix.net/8276/20168276/interior_boot-1773243998025.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/8276/20168276/docs_service_history-1773257599615.jpg?ixlib=js-3.8.0&auto=format&s=5e8759a26123c1f84375f809c3274c5c'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1850567,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_front_driver-1773243602973.jpg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2491261,
'Height': 3016,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_rear_driver-1773243536938.jpg',
'Width': 4021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203526,
'Height': 2858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_front_passenger-1773243593399.jpg',
'Width': 3810},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2269842,
'Height': 2844,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8276/20168276/exterior_rear_passenger-1773243565972.jpg',
'Width': 3792},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3652464,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8276/20168276/interior_front_seats-1773243881361.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3691276,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8276/20168276/interior_rear_seats-1773243928941.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1974755,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8276/20168276/interior_dashboard-1773504707908.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1273964,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8276/20168276/instrument_cluster-1773244254309.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3750236,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8276/20168276/interior_boot-1773243998025.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d7823-5b78-5968-8d96-51425e07a486/724d7823-5b78-5968-8d96-51425e07a486_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1787820,
'Height': 1890,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8276/20168276/docs_service_history-1773257599615.jpg?ixlib=js-3.8.0&auto=format&s=5e8759a26123c1f84375f809c3274c5c',
'Width': 2451}],
'price': 24200,
'price_includes_vat': False,
'registration_date': '2024-09-26',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 3 MHEV S-A',
'transmission': 'automatic',
'trim': '3 MHEV S-A',
'vin': 'U5YPV81BVSL348509',
'year': 2024}
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720168276%27 HTTP/1.1" 200 None
2026-03-29 20:26:49 [motorway.uk] INFO: Saving data for 20168276: {'created_time': 1774816009.63471, 'last_price_update_time': 1774816009.634722, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20168276') HTTP/1.1" 204 0
2026-03-29 20:26:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2c4050>
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1111%252F20441111%252Finterior_front_seats-1774696812865.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1111/20441111/interior_front_seats-1774696812865.jpg saved to cache
2026-03-29 20:26:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3472/20483472/instrument_cluster-1774776560139.jpg> (referer: None)
2026-03-29 20:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3472/20483472/interior_dashboard-1774776443251.jpg> (referer: None)
2026-03-29 20:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3472/20483472/interior_boot-1774776427515.jpg> (referer: None)
2026-03-29 20:26:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3472/20483472/interior_rear_seats-1774776424189.jpg> (referer: None)
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2c6910>
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Finstrument_cluster-1774776560139.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/instrument_cluster-1774776560139.jpg saved to cache
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c65a010>
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Finterior_dashboard-1774776443251.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/interior_dashboard-1774776443251.jpg saved to cache
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec1d290>
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3472%252F20483472%252Finterior_boot-1774776427515.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3472/20483472/interior_boot-1774776427515.jpg saved to cache
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba7c90>
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3472%252F20483472%252Finterior_rear_seats-1774776424189.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3472/20483472/interior_rear_seats-1774776424189.jpg saved to cache
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20323347.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3472/20483472/interior_front_seats-1774776424898.jpg> (referer: None)
2026-03-29 20:26:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2157fb6-63df-5a03-a4fd-fb298d7b97cc with identifier: 20323347
2026-03-29 20:26:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc with scrape type 1
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_front_driver-1774690523728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_driver-1774690523728.jpg not downloaded yet
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_rear_driver-1774690538292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_driver-1774690538292.jpg not downloaded yet
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_front_passenger-1774690555586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_passenger-1774690555586.jpg not downloaded yet
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c407910>
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3472%252F20483472%252Finterior_front_seats-1774776424898.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3472/20483472/interior_front_seats-1774776424898.jpg saved to cache
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_rear_passenger-1774690551385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_passenger-1774690551385.jpg not downloaded yet
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3347%252F20323347%252Finterior_front_seats-1774691273408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3347/20323347/interior_front_seats-1774691273408.jpg not downloaded yet
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3347%252F20323347%252Finterior_rear_seats-1774691308643.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3347/20323347/interior_rear_seats-1774691308643.jpg not downloaded yet
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_driver-1774776063377.jpg> (referer: None)
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Finterior_dashboard-1774691263850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/interior_dashboard-1774691263850.jpg not downloaded yet
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Finstrument_cluster-1774691328512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/instrument_cluster-1774691328512.jpg not downloaded yet
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3347%252F20323347%252Finterior_boot-1774691441552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3347/20323347/interior_boot-1774691441552.jpg not downloaded yet
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3347%252F20323347%252Fdocs_service_history-1774691834421.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9249c31e19650a68b6b70eef111a9ce8%27 HTTP/1.1" 200 None
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3347/20323347/docs_service_history-1774691834421.jpg?ixlib=js-3.8.0&auto=format&s=9249c31e19650a68b6b70eef111a9ce8 not downloaded yet
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_passenger-1774776072103.jpg> (referer: None)
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_passenger-1774776075785.jpg> (referer: None)
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c274990>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_front_driver-1774776063377.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_driver-1774776063377.jpg saved to cache
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d262390>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_rear_passenger-1774776072103.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_passenger-1774776072103.jpg saved to cache
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d547410>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_front_passenger-1774776075785.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_passenger-1774776075785.jpg saved to cache
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_passenger-1774696113605.jpg> (referer: None)
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3347/20323347/docs_service_history-1774691834421.jpg?ixlib=js-3.8.0&auto=format&s=9249c31e19650a68b6b70eef111a9ce8> (referer: None)
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb39e10>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_rear_passenger-1774696113605.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_passenger-1774696113605.jpg saved to cache
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d068e90>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3347%252F20323347%252Fdocs_service_history-1774691834421.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9249c31e19650a68b6b70eef111a9ce8') HTTP/1.1" 204 0
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3347/20323347/docs_service_history-1774691834421.jpg?ixlib=js-3.8.0&auto=format&s=9249c31e19650a68b6b70eef111a9ce8 saved to cache
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3347/20323347/interior_front_seats-1774691273408.jpg> (referer: None)
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3347/20323347/interior_boot-1774691441552.jpg> (referer: None)
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_driver-1774776960451.jpg> (referer: None)
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3347/20323347/interior_dashboard-1774691263850.jpg> (referer: None)
2026-03-29 20:26:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3347/20323347/instrument_cluster-1774691328512.jpg> (referer: None)
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d545510>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3347%252F20323347%252Finterior_front_seats-1774691273408.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3347/20323347/interior_front_seats-1774691273408.jpg saved to cache
2026-03-29 20:26:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d195d10>
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3347%252F20323347%252Finterior_boot-1774691441552.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3347/20323347/interior_boot-1774691441552.jpg saved to cache
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e974290>
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3472%252F20483472%252Fexterior_rear_driver-1774776960451.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_driver-1774776960451.jpg saved to cache
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76c715d2-c605-5703-b12b-32655ea2eae6
2026-03-29 20:26:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76c715d2-c605-5703-b12b-32655ea2eae6, skipping ID generation
2026-03-29 20:26:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c715d2-c605-5703-b12b-32655ea2eae6 with scrape type 1
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76c715d2-c605-5703-b12b-32655ea2eae6 sending to next pipeline
2026-03-29 20:26:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 76c715d2-c605-5703-b12b-32655ea2eae6, identifier: 20483472
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c276010>
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Finterior_dashboard-1774691263850.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/interior_dashboard-1774691263850.jpg saved to cache
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce0e090>
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Finstrument_cluster-1774691328512.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/instrument_cluster-1774691328512.jpg saved to cache
2026-03-29 20:26:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 76c715d2-c605-5703-b12b-32655ea2eae6 with identifier: 20483472
2026-03-29 20:26:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 76c715d2-c605-5703-b12b-32655ea2eae6 with identifier: 20483472
2026-03-29 20:26:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 76c715d2-c605-5703-b12b-32655ea2eae6 with identifier: 20483472 to the API
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_driver-1774776960451.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '76c715d2-c605-5703-b12b-32655ea2eae6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MV18 KAX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20483472',
'listing': 'auction',
'location': 'East Sussex Hastings',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 66101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1496988,
'Height': 2220,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_driver-1774776063377.jpg',
'Width': 2960},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1674810,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_driver-1774776960451.jpg',
'Width': 3643},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623951,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_front_passenger-1774776075785.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1420122,
'Height': 2589,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3472/20483472/exterior_rear_passenger-1774776072103.jpg',
'Width': 3452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3465969,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3472/20483472/interior_front_seats-1774776424898.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3158195,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3472/20483472/interior_rear_seats-1774776424189.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2789352,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3472/20483472/interior_dashboard-1774776443251.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379413,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3472/20483472/instrument_cluster-1774776560139.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3110420,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3472/20483472/interior_boot-1774776427515.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76c715d2-c605-5703-b12b-32655ea2eae6/76c715d2-c605-5703-b12b-32655ea2eae6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1570562,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3472/20483472/docs_service_history-1774776649198.jpg?ixlib=js-3.8.0&auto=format&s=87470e4568c2d874ff77b57a753c8eae',
'Width': 2880}],
'price': 13814,
'price_includes_vat': False,
'registration_date': '2018-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Kodiaq Edition TDI SCR 4X4 S-A',
'transmission': 'automatic',
'trim': 'Edition TDI SCR 4X4 S-A',
'vin': 'TMBMK7NS1J8059625',
'year': 2018}
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483472%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [motorway.uk] INFO: Saving data for 20483472: {'created_time': 1774816013.012626, 'last_price_update_time': 1774816013.012637, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20483472') HTTP/1.1" 204 0
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3347/20323347/interior_rear_seats-1774691308643.jpg> (referer: None)
2026-03-29 20:26:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caf8950>
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3347%252F20323347%252Finterior_rear_seats-1774691308643.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3347/20323347/interior_rear_seats-1774691308643.jpg saved to cache
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19297070.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4109910.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_driver-1774690538292.jpg> (referer: None)
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_passenger-1774690551385.jpg> (referer: None)
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_passenger-1774690555586.jpg> (referer: None)
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_driver-1774690523728.jpg> (referer: None)
2026-03-29 20:26:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c067b48-bf75-504d-9027-3e800c372e4e with identifier: 19297070
2026-03-29 20:26:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c067b48-bf75-504d-9027-3e800c372e4e with scrape type 1
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_front_driver-1772987607378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_driver-1772987607378.jpg not downloaded yet
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_rear_driver-1772987655284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_driver-1772987655284.jpg not downloaded yet
2026-03-29 20:26:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a78efc3-a8e3-599d-a47f-6fabe0863a42 with identifier: 4109910
2026-03-29 20:26:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42 with scrape type 1
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_front_driver-1774713127786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_driver-1774713127786.jpg not downloaded yet
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_front_passenger-1772987516688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_passenger-1772987516688.jpg not downloaded yet
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_rear_driver-1774713255218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_driver-1774713255218.jpg not downloaded yet
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c29f410>
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_rear_driver-1774690538292.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_driver-1774690538292.jpg saved to cache
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_rear_passenger-1772987564279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_passenger-1772987564279.jpg not downloaded yet
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_front_passenger-1774713106284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_passenger-1774713106284.jpg not downloaded yet
2026-03-29 20:26:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10736639.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:26:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ff350>
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_rear_passenger-1774690551385.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_passenger-1774690551385.jpg saved to cache
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f0a190>
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_front_passenger-1774690555586.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_passenger-1774690555586.jpg saved to cache
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7386d0>
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3347%252F20323347%252Fexterior_front_driver-1774690523728.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_driver-1774690523728.jpg saved to cache
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc
2026-03-29 20:26:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2157fb6-63df-5a03-a4fd-fb298d7b97cc, skipping ID generation
2026-03-29 20:26:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc with scrape type 1
2026-03-29 20:26:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2157fb6-63df-5a03-a4fd-fb298d7b97cc sending to next pipeline
2026-03-29 20:26:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f2157fb6-63df-5a03-a4fd-fb298d7b97cc, identifier: 20323347
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7070%252F19297070%252Finterior_front_seats-1772988640690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7070/19297070/interior_front_seats-1772988640690.jpg not downloaded yet
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_rear_passenger-1774713148233.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_passenger-1774713148233.jpg not downloaded yet
2026-03-29 20:26:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f2157fb6-63df-5a03-a4fd-fb298d7b97cc with identifier: 20323347
2026-03-29 20:26:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f2157fb6-63df-5a03-a4fd-fb298d7b97cc with identifier: 20323347
2026-03-29 20:26:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f2157fb6-63df-5a03-a4fd-fb298d7b97cc with identifier: 20323347 to the API
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_driver-1774690523728.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f2157fb6-63df-5a03-a4fd-fb298d7b97cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FE14 NER',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20323347',
'listing': 'auction',
'location': 'Lincolnshire Grimsby',
'make': 'SEAT',
'model': 'Tarraco',
'odometer': 51500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2092756,
'Height': 2935,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_driver-1774690523728.jpg',
'Width': 3913},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 825627,
'Height': 2270,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_driver-1774690538292.jpg',
'Width': 3027},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1321349,
'Height': 2267,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_front_passenger-1774690555586.jpg',
'Width': 3022},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539139,
'Height': 2588,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3347/20323347/exterior_rear_passenger-1774690551385.jpg',
'Width': 3451},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3310172,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3347/20323347/interior_front_seats-1774691273408.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3030966,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3347/20323347/interior_rear_seats-1774691308643.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1692776,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3347/20323347/interior_dashboard-1774691263850.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2198265,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3347/20323347/instrument_cluster-1774691328512.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3392106,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3347/20323347/interior_boot-1774691441552.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2157fb6-63df-5a03-a4fd-fb298d7b97cc/f2157fb6-63df-5a03-a4fd-fb298d7b97cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290042,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3347/20323347/docs_service_history-1774691834421.jpg?ixlib=js-3.8.0&auto=format&s=9249c31e19650a68b6b70eef111a9ce8',
'Width': 1179}],
'price': 18494,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Tarraco X-LNC LUX TSI 4D SA',
'transmission': 'automatic',
'trim': 'X-LNC LUX TSI 4D SA',
'vin': 'VSSZZZKN0PW006638',
'year': 2023}
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720323347%27 HTTP/1.1" 200 None
2026-03-29 20:26:54 [motorway.uk] INFO: Saving data for 20323347: {'created_time': 1774816014.476258, 'last_price_update_time': 1774816014.476268, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20323347') HTTP/1.1" 204 0
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7070%252F19297070%252Finterior_rear_seats-1772988504956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7070/19297070/interior_rear_seats-1772988504956.jpg not downloaded yet
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9910%252F4109910%252Finterior_front_seats-1774713522057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9910/4109910/interior_front_seats-1774713522057.jpg not downloaded yet
2026-03-29 20:26:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08576b60-c714-5380-b261-ab352e8ea59f with identifier: 10736639
2026-03-29 20:26:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08576b60-c714-5380-b261-ab352e8ea59f with scrape type 2
2026-03-29 20:26:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08576b60-c714-5380-b261-ab352e8ea59f with scrape type 2
2026-03-29 20:26:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 08576b60-c714-5380-b261-ab352e8ea59f, identifier: 10736639
2026-03-29 20:26:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 08576b60-c714-5380-b261-ab352e8ea59f with identifier: 10736639
2026-03-29 20:26:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 08576b60-c714-5380-b261-ab352e8ea59f with identifier: 10736639
2026-03-29 20:26:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 08576b60-c714-5380-b261-ab352e8ea59f with identifier: 10736639 to the API
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10736639.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '08576b60-c714-5380-b261-ab352e8ea59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'J9 GGK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10736639',
'listing': 'auction',
'location': 'West Midlands Willenhall',
'make': 'MINI',
'model': 'One',
'odometer': 82111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 4060,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seats_number': None,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'vin': 'WMWXS120002C84066',
'year': 2017}
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710736639%27 HTTP/1.1" 200 None
2026-03-29 20:26:54 [motorway.uk] INFO: Saving data for 10736639: {'auction_closing_time': 1774884600.0, 'created_time': 1774557120.703539, 'last_price_update_time': 1774816014.992646}
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10736639') HTTP/1.1" 204 0
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7070%252F19297070%252F19297070-interior_dashboard-modified-1774602550850.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7070/19297070/19297070-interior_dashboard-modified-1774602550850.jpeg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9910%252F4109910%252Finterior_rear_seats-1774713650057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9910/4109910/interior_rear_seats-1774713650057.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7070%252F19297070%252Finterior_boot-1772988375063.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7070/19297070/interior_boot-1772988375063.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Finterior_dashboard-1774713707196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/interior_dashboard-1774713707196.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fwheels_front_driver-1772988043163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_front_driver-1772988043163.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Finstrument_cluster-1774716916488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/instrument_cluster-1774716916488.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fwheels_rear_driver-1772988065378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_rear_driver-1772988065378.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9910%252F4109910%252Finterior_boot-1774713735482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9910/4109910/interior_boot-1774713735482.jpg not downloaded yet
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9910%252F4109910%252Fdocs_service_history-1774707689067.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c718d22b424789f1e2f3f4aecbac5a9%27 HTTP/1.1" 200 None
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9910/4109910/docs_service_history-1774707689067.jpg?ixlib=js-3.8.0&auto=format&s=1c718d22b424789f1e2f3f4aecbac5a9 not downloaded yet
2026-03-29 20:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_passenger-1774696130881.jpg> (referer: None)
2026-03-29 20:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694957984.jpg?ixlib=js-3.8.0&auto=format&s=9561e13722ddba1b71d2ed2046c43509> (referer: None)
2026-03-29 20:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_driver-1774696059708.jpg> (referer: None)
2026-03-29 20:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_driver-1774696098017.jpg> (referer: None)
2026-03-29 20:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_passenger-1774713148233.jpg> (referer: None)
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8cb10>
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_front_passenger-1774696130881.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_passenger-1774696130881.jpg saved to cache
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:55 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (10879644) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7070/19297070/interior_front_seats-1772988640690.jpg>.
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8e950>
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F20470703%252Fdocs_service_history-1774694957984.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9561e13722ddba1b71d2ed2046c43509') HTTP/1.1" 204 0
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694957984.jpg?ixlib=js-3.8.0&auto=format&s=9561e13722ddba1b71d2ed2046c43509 saved to cache
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15cf90>
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_front_driver-1774696059708.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_driver-1774696059708.jpg saved to cache
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb1590>
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1111%252F20441111%252Fexterior_rear_driver-1774696098017.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_driver-1774696098017.jpg saved to cache
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5
2026-03-29 20:26:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a685a56-a9e2-5c01-ae39-a7ea56fefca5, skipping ID generation
2026-03-29 20:26:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 with scrape type 1
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 sending to next pipeline
2026-03-29 20:26:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2a685a56-a9e2-5c01-ae39-a7ea56fefca5, identifier: 20441111
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c257910>
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_rear_passenger-1774713148233.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_passenger-1774713148233.jpg saved to cache
2026-03-29 20:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 with identifier: 20441111
2026-03-29 20:26:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 with identifier: 20441111
2026-03-29 20:26:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2a685a56-a9e2-5c01-ae39-a7ea56fefca5 with identifier: 20441111 to the API
2026-03-29 20:26:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_driver-1774696098017.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '2a685a56-a9e2-5c01-ae39-a7ea56fefca5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WJ74 KFP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20441111',
'listing': 'auction',
'location': 'Somerset Bridgwater',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 12003,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2159205,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_driver-1774696059708.jpg',
'Width': 3791},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2047216,
'Height': 2791,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_driver-1774696098017.jpg',
'Width': 3721},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1410398,
'Height': 2415,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_front_passenger-1774696130881.jpg',
'Width': 3220},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2348423,
'Height': 2928,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1111/20441111/exterior_rear_passenger-1774696113605.jpg',
'Width': 3904},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3481297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1111/20441111/interior_front_seats-1774696812865.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2918423,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1111/20441111/interior_rear_seats-1774696856200.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3073420,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1111/20441111/interior_dashboard-1774697010588.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2296997,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1111/20441111/instrument_cluster-1774696850131.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4035732,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1111/20441111/interior_boot-1774697072255.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a685a56-a9e2-5c01-ae39-a7ea56fefca5/2a685a56-a9e2-5c01-ae39-a7ea56fefca5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379656,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1111/20441111/docs_service_history-1774699047990.jpg?ixlib=js-3.8.0&auto=format&s=80d70b0a1079eeb3d19ff9a0f78d5a9e',
'Width': 1179}],
'price': 24459,
'price_includes_vat': False,
'registration_date': '2024-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Cross Prem ED HEV CVT',
'transmission': 'automatic',
'trim': 'Cross Prem ED HEV CVT',
'vin': 'JTDKGAGB40A032557',
'year': 2024}
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441111%27 HTTP/1.1" 200 None
2026-03-29 20:26:56 [motorway.uk] INFO: Saving data for 20441111: {'created_time': 1774816016.16094, 'last_price_update_time': 1774816016.160951, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20441111') HTTP/1.1" 204 0
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9910/4109910/docs_service_history-1774707689067.jpg?ixlib=js-3.8.0&auto=format&s=1c718d22b424789f1e2f3f4aecbac5a9> (referer: None)
2026-03-29 20:26:56 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/7070/19297070/interior_front_seats-1772988640690.jpg>.
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7070/19297070/interior_front_seats-1772988640690.jpg> (referer: None)
2026-03-29 20:26:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:26:56 [PIL.PngImagePlugin] DEBUG: STREAM b'sBIT' 41 4
2026-03-29 20:26:56 [PIL.PngImagePlugin] DEBUG: b'sBIT' 41 4 (unknown)
2026-03-29 20:26:56 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 57 1
2026-03-29 20:26:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 70 8192
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2eda90>
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_9.png HTTP/1.1" 201 0
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9910%252F4109910%252Fdocs_service_history-1774707689067.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c718d22b424789f1e2f3f4aecbac5a9') HTTP/1.1" 204 0
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9910/4109910/docs_service_history-1774707689067.jpg?ixlib=js-3.8.0&auto=format&s=1c718d22b424789f1e2f3f4aecbac5a9 saved to cache
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S928B\x00'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S928BXXS4CZA1\x00'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 16:50:34\x00'
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c256a90>
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7070%252F19297070%252Finterior_front_seats-1772988640690.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7070/19297070/interior_front_seats-1772988640690.jpg saved to cache
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9910/4109910/interior_boot-1774713735482.jpg> (referer: None)
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_front_driver-1772988043163.jpg> (referer: None)
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9910/4109910/instrument_cluster-1774716916488.jpg> (referer: None)
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9910/4109910/interior_dashboard-1774713707196.jpg> (referer: None)
2026-03-29 20:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9910/4109910/interior_front_seats-1774713522057.jpg> (referer: None)
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca99d10>
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9910%252F4109910%252Finterior_boot-1774713735482.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9910/4109910/interior_boot-1774713735482.jpg saved to cache
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d293a10>
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fwheels_front_driver-1772988043163.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_front_driver-1772988043163.jpg saved to cache
2026-03-29 20:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb0c10>
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Finstrument_cluster-1774716916488.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/instrument_cluster-1774716916488.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31f210>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Finterior_dashboard-1774713707196.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/interior_dashboard-1774713707196.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c69790>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9910%252F4109910%252Finterior_front_seats-1774713522057.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9910/4109910/interior_front_seats-1774713522057.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_rear_driver-1772988065378.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9910/4109910/interior_rear_seats-1774713650057.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7070/19297070/19297070-interior_dashboard-modified-1774602550850.jpeg> (referer: None)
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2114d0>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fwheels_rear_driver-1772988065378.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_rear_driver-1772988065378.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:57 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.404(s), this was the 1st time calling it.
2026-03-29 20:26:57 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.136832414528139 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec46b90>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9910%252F4109910%252Finterior_rear_seats-1774713650057.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9910/4109910/interior_rear_seats-1774713650057.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d191c90>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7070%252F19297070%252F19297070-interior_dashboard-modified-1774602550850.jpeg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7070/19297070/19297070-interior_dashboard-modified-1774602550850.jpeg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_driver-1774713255218.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_passenger-1774713106284.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_passenger-1772987516688.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_passenger-1772987564279.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7070/19297070/interior_boot-1772988375063.jpg> (referer: None)
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7070/19297070/interior_rear_seats-1772988504956.jpg> (referer: None)
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15c7d0>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_rear_driver-1774713255218.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_driver-1774713255218.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce5cf90>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_front_passenger-1774713106284.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_passenger-1774713106284.jpg saved to cache
2026-03-29 20:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_driver-1774713127786.jpg> (referer: None)
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95d990>
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_front_passenger-1772987516688.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_passenger-1772987516688.jpg saved to cache
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc15513010>
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_rear_passenger-1772987564279.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_passenger-1772987564279.jpg saved to cache
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S928B\x00'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S928BXXS4CZA1\x00'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 16:46:08\x00'
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2ed690>
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7070%252F19297070%252Finterior_boot-1772988375063.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7070/19297070/interior_boot-1772988375063.jpg saved to cache
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S928B\x00'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S928BXXS4CZA1\x00'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:26:58 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:08 16:48:17\x00'
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec448d0>
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7070%252F19297070%252Finterior_rear_seats-1772988504956.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7070/19297070/interior_rear_seats-1772988504956.jpg saved to cache
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e1210>
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9910%252F4109910%252Fexterior_front_driver-1774713127786.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_driver-1774713127786.jpg saved to cache
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42
2026-03-29 20:26:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a78efc3-a8e3-599d-a47f-6fabe0863a42, skipping ID generation
2026-03-29 20:26:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42 with scrape type 1
2026-03-29 20:26:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a78efc3-a8e3-599d-a47f-6fabe0863a42 sending to next pipeline
2026-03-29 20:26:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3a78efc3-a8e3-599d-a47f-6fabe0863a42, identifier: 4109910
2026-03-29 20:26:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3a78efc3-a8e3-599d-a47f-6fabe0863a42 with identifier: 4109910
2026-03-29 20:26:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3a78efc3-a8e3-599d-a47f-6fabe0863a42 with identifier: 4109910
2026-03-29 20:26:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3a78efc3-a8e3-599d-a47f-6fabe0863a42 with identifier: 4109910 to the API
2026-03-29 20:26:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_driver-1774713127786.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3a78efc3-a8e3-599d-a47f-6fabe0863a42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M55 SNH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4109910',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 92754,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661869,
'Height': 2166,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_driver-1774713127786.jpg',
'Width': 2888},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527735,
'Height': 2033,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_driver-1774713255218.jpg',
'Width': 2710},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531002,
'Height': 1859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_front_passenger-1774713106284.jpg',
'Width': 2479},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381091,
'Height': 1721,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9910/4109910/exterior_rear_passenger-1774713148233.jpg',
'Width': 2294},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238980,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/9910/4109910/interior_front_seats-1774713522057.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1291674,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/9910/4109910/interior_rear_seats-1774713650057.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1187172,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9910/4109910/interior_dashboard-1774713707196.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765813,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9910/4109910/instrument_cluster-1774716916488.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387860,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/9910/4109910/interior_boot-1774713735482.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a78efc3-a8e3-599d-a47f-6fabe0863a42/3a78efc3-a8e3-599d-a47f-6fabe0863a42_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 373659,
'Height': 1406,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9910/4109910/docs_service_history-1774707689067.jpg?ixlib=js-3.8.0&auto=format&s=1c718d22b424789f1e2f3f4aecbac5a9',
'Width': 1046}],
'price': 13047,
'price_includes_vat': False,
'registration_date': '2017-04-10',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Luxury HSE SD4 Auto',
'transmission': 'automatic',
'trim': 'Luxury HSE SD4 Auto',
'vin': 'SALRA2AN6HA012341',
'year': 2017}
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274109910%27 HTTP/1.1" 200 None
2026-03-29 20:26:59 [motorway.uk] INFO: Saving data for 4109910: {'created_time': 1774816019.152458, 'last_price_update_time': 1774816019.152467, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4109910') HTTP/1.1" 204 0
2026-03-29 20:26:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_driver-1772987655284.jpg> (referer: None)
2026-03-29 20:26:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_driver-1772987607378.jpg> (referer: None)
2026-03-29 20:26:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694940725.jpg?ixlib=js-3.8.0&auto=format&s=6194bb3165fc90853793f9b623a6e71f> (referer: None)
2026-03-29 20:26:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0703/20470703/interior_boot-1774693291150.jpg> (referer: None)
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e2310>
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_rear_driver-1772987655284.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_driver-1772987655284.jpg saved to cache
2026-03-29 20:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea86f90>
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7070%252F19297070%252Fexterior_front_driver-1772987607378.jpg') HTTP/1.1" 204 0
2026-03-29 20:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_driver-1772987607378.jpg saved to cache
2026-03-29 20:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c067b48-bf75-504d-9027-3e800c372e4e
2026-03-29 20:26:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c067b48-bf75-504d-9027-3e800c372e4e, skipping ID generation
2026-03-29 20:26:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c067b48-bf75-504d-9027-3e800c372e4e with scrape type 1
2026-03-29 20:26:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c067b48-bf75-504d-9027-3e800c372e4e sending to next pipeline
2026-03-29 20:26:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1c067b48-bf75-504d-9027-3e800c372e4e, identifier: 19297070
2026-03-29 20:26:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1c067b48-bf75-504d-9027-3e800c372e4e with identifier: 19297070
2026-03-29 20:26:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1c067b48-bf75-504d-9027-3e800c372e4e with identifier: 19297070
2026-03-29 20:26:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1c067b48-bf75-504d-9027-3e800c372e4e with identifier: 19297070 to the API
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:26:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_driver-1772987607378.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '1c067b48-bf75-504d-9027-3e800c372e4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KK25 HZJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19297070',
'listing': 'auction',
'location': 'Luton Luton',
'make': 'Peugeot',
'model': '5008',
'odometer': 2700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 903836,
'Height': 2138,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_driver-1772987607378.jpg',
'Width': 2851},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570680,
'Height': 1839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_driver-1772987655284.jpg',
'Width': 2452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 753582,
'Height': 2194,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_front_passenger-1772987516688.jpg',
'Width': 2925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 907066,
'Height': 2242,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7070/19297070/exterior_rear_passenger-1772987564279.jpg',
'Width': 2989},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10879644,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/7070/19297070/interior_front_seats-1772988640690.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7910378,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/7070/19297070/interior_rear_seats-1772988504956.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2505939,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7070/19297070/19297070-interior_dashboard-modified-1774602550850.jpeg',
'Width': 5440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6195033,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/7070/19297070/interior_boot-1772988375063.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 612832,
'Height': 2093,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_front_driver-1772988043163.jpg',
'Width': 2791},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c067b48-bf75-504d-9027-3e800c372e4e/1c067b48-bf75-504d-9027-3e800c372e4e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639788,
'Height': 2051,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7070/19297070/wheels_rear_driver-1772988065378.jpg',
'Width': 2735}],
'price': 25700,
'price_includes_vat': False,
'registration_date': '2025-08-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 5008 Allure MHEV Auto',
'transmission': 'automatic',
'trim': 'Allure MHEV Auto',
'vin': 'VR3KAHPYXSS141227',
'year': 2025}
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719297070%27 HTTP/1.1" 200 None
2026-03-29 20:26:59 [motorway.uk] INFO: Saving data for 19297070: {'created_time': 1774816019.956513, 'last_price_update_time': 1774816019.956525, 'auction_closing_time': 1774884600.0}
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19297070') HTTP/1.1" 204 0
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e0410>
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:26:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F20470703%252Fdocs_service_history-1774694940725.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6194bb3165fc90853793f9b623a6e71f') HTTP/1.1" 204 0
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694940725.jpg?ixlib=js-3.8.0&auto=format&s=6194bb3165fc90853793f9b623a6e71f saved to cache
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e3c50>
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F20470703%252Finterior_boot-1774693291150.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/20470703/interior_boot-1774693291150.jpg saved to cache
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0703/20470703/interior_dashboard-1774694703285.jpg> (referer: None)
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce14390>
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0703%252F20470703%252Finterior_dashboard-1774694703285.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0703/20470703/interior_dashboard-1774694703285.jpg saved to cache
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0703/20470703/interior_rear_seats-1774693297996.jpg> (referer: None)
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ed410>
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F20470703%252Finterior_rear_seats-1774693297996.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/20470703/interior_rear_seats-1774693297996.jpg saved to cache
2026-03-29 20:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0703/20470703/interior_front_seats-1774693301437.jpg> (referer: None)
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edebb90>
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F20470703%252Finterior_front_seats-1774693301437.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/20470703/interior_front_seats-1774693301437.jpg saved to cache
2026-03-29 20:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:27:05 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 22 pages/min), scraped 217 items (at 21 items/min)
2026-03-29 20:27:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20378364.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661a0d9c-5b15-52bb-aad8-26cb928537dd with identifier: 20378364
2026-03-29 20:27:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661a0d9c-5b15-52bb-aad8-26cb928537dd with scrape type 1
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_front_driver-1774540965422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_driver-1774540965422.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_rear_driver-1774540913592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_driver-1774540913592.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_front_passenger-1774540797500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_passenger-1774540797500.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_rear_passenger-1774540764014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_passenger-1774540764014.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8364%252F20378364%252Finterior_front_seats-1774695561543.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8364/20378364/interior_front_seats-1774695561543.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8364%252F20378364%252Finterior_rear_seats-1774695463226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8364/20378364/interior_rear_seats-1774695463226.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Finterior_dashboard-1774695335977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/interior_dashboard-1774695335977.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8364%252F20378364%252Finterior_boot-1774695768752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8364/20378364/interior_boot-1774695768752.jpg not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8364%252F20378364%252Fdocs_service_history-1774697276674.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ee9eb17a659007288fece1308912f49%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697276674.jpg?ixlib=js-3.8.0&auto=format&s=1ee9eb17a659007288fece1308912f49 not downloaded yet
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8364%252F20378364%252Fdocs_service_history-1774697371466.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daf01fcfe594c6eda1d2ced59e6629f53%27 HTTP/1.1" 200 None
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697371466.jpg?ixlib=js-3.8.0&auto=format&s=af01fcfe594c6eda1d2ced59e6629f53 not downloaded yet
2026-03-29 20:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_driver-1774692744004.jpg> (referer: None)
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28a710>
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_rear_driver-1774692744004.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_driver-1774692744004.jpg saved to cache
2026-03-29 20:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697371466.jpg?ixlib=js-3.8.0&auto=format&s=af01fcfe594c6eda1d2ced59e6629f53> (referer: None)
2026-03-29 20:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697276674.jpg?ixlib=js-3.8.0&auto=format&s=1ee9eb17a659007288fece1308912f49> (referer: None)
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3fad10>
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8364%252F20378364%252Fdocs_service_history-1774697371466.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daf01fcfe594c6eda1d2ced59e6629f53') HTTP/1.1" 204 0
2026-03-29 20:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697371466.jpg?ixlib=js-3.8.0&auto=format&s=af01fcfe594c6eda1d2ced59e6629f53 saved to cache
2026-03-29 20:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d089fd0>
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8364%252F20378364%252Fdocs_service_history-1774697276674.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ee9eb17a659007288fece1308912f49') HTTP/1.1" 204 0
2026-03-29 20:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697276674.jpg?ixlib=js-3.8.0&auto=format&s=1ee9eb17a659007288fece1308912f49 saved to cache
2026-03-29 20:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8364/20378364/interior_boot-1774695768752.jpg> (referer: None)
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3f9b10>
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8364%252F20378364%252Finterior_boot-1774695768752.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8364/20378364/interior_boot-1774695768752.jpg saved to cache
2026-03-29 20:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8364/20378364/interior_dashboard-1774695335977.jpg> (referer: None)
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e3410>
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Finterior_dashboard-1774695335977.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/interior_dashboard-1774695335977.jpg saved to cache
2026-03-29 20:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8364/20378364/interior_rear_seats-1774695463226.jpg> (referer: None)
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28a290>
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8364%252F20378364%252Finterior_rear_seats-1774695463226.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8364/20378364/interior_rear_seats-1774695463226.jpg saved to cache
2026-03-29 20:27:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8364/20378364/interior_front_seats-1774695561543.jpg> (referer: None)
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec9f5d0>
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8364%252F20378364%252Finterior_front_seats-1774695561543.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8364/20378364/interior_front_seats-1774695561543.jpg saved to cache
2026-03-29 20:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_passenger-1774540764014.jpg> (referer: None)
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e9e10>
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_rear_passenger-1774540764014.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_passenger-1774540764014.jpg saved to cache
2026-03-29 20:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_passenger-1774540797500.jpg> (referer: None)
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec9cf50>
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_front_passenger-1774540797500.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_passenger-1774540797500.jpg saved to cache
2026-03-29 20:27:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_driver-1774540913592.jpg> (referer: None)
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e0e10>
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_rear_driver-1774540913592.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_driver-1774540913592.jpg saved to cache
2026-03-29 20:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_driver-1774540965422.jpg> (referer: None)
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58d710>
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8364%252F20378364%252Fexterior_front_driver-1774540965422.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_driver-1774540965422.jpg saved to cache
2026-03-29 20:27:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 661a0d9c-5b15-52bb-aad8-26cb928537dd
2026-03-29 20:27:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 661a0d9c-5b15-52bb-aad8-26cb928537dd, skipping ID generation
2026-03-29 20:27:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661a0d9c-5b15-52bb-aad8-26cb928537dd with scrape type 1
2026-03-29 20:27:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 661a0d9c-5b15-52bb-aad8-26cb928537dd sending to next pipeline
2026-03-29 20:27:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 661a0d9c-5b15-52bb-aad8-26cb928537dd, identifier: 20378364
2026-03-29 20:27:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 661a0d9c-5b15-52bb-aad8-26cb928537dd with identifier: 20378364
2026-03-29 20:27:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 661a0d9c-5b15-52bb-aad8-26cb928537dd with identifier: 20378364
2026-03-29 20:27:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 661a0d9c-5b15-52bb-aad8-26cb928537dd with identifier: 20378364 to the API
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_driver-1774540965422.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '661a0d9c-5b15-52bb-aad8-26cb928537dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE18 OVU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20378364',
'listing': 'auction',
'location': 'Hertfordshire St Albans',
'make': 'Hyundai',
'model': 'I30',
'odometer': 14317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3060917,
'Height': 2904,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_driver-1774540965422.jpg',
'Width': 3872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2769302,
'Height': 2675,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_driver-1774540913592.jpg',
'Width': 3567},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2713228,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_front_passenger-1774540797500.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2258833,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8364/20378364/exterior_rear_passenger-1774540764014.jpg',
'Width': 3535},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2322310,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8364/20378364/interior_front_seats-1774695561543.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087647,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8364/20378364/interior_rear_seats-1774695463226.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3734121,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8364/20378364/interior_dashboard-1774695335977.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4746461,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8364/20378364/interior_boot-1774695768752.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 863742,
'Height': 3285,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697276674.jpg?ixlib=js-3.8.0&auto=format&s=1ee9eb17a659007288fece1308912f49',
'Width': 2286},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_661a0d9c-5b15-52bb-aad8-26cb928537dd/661a0d9c-5b15-52bb-aad8-26cb928537dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661851,
'Height': 2008,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8364/20378364/docs_service_history-1774697371466.jpg?ixlib=js-3.8.0&auto=format&s=af01fcfe594c6eda1d2ced59e6629f53',
'Width': 2748}],
'price': 21188,
'price_includes_vat': False,
'registration_date': '2018-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I30 N Performance T-GDi',
'transmission': 'manual',
'trim': 'N Performance T-GDi',
'vin': 'TMAHC51ALJJ002080',
'year': 2018}
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720378364%27 HTTP/1.1" 200 None
2026-03-29 20:27:27 [motorway.uk] INFO: Saving data for 20378364: {'created_time': 1774816047.952981, 'last_price_update_time': 1774816047.952991, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20378364') HTTP/1.1" 204 0
2026-03-29 20:27:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_driver-1774692748618.jpg> (referer: None)
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3f9450>
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F20470703%252Fexterior_front_driver-1774692748618.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_driver-1774692748618.jpg saved to cache
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fad4611a-c624-57db-a258-dd1855d4a417
2026-03-29 20:27:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fad4611a-c624-57db-a258-dd1855d4a417, skipping ID generation
2026-03-29 20:27:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fad4611a-c624-57db-a258-dd1855d4a417 with scrape type 1
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fad4611a-c624-57db-a258-dd1855d4a417 sending to next pipeline
2026-03-29 20:27:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fad4611a-c624-57db-a258-dd1855d4a417, identifier: 20470703
2026-03-29 20:27:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fad4611a-c624-57db-a258-dd1855d4a417 with identifier: 20470703
2026-03-29 20:27:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fad4611a-c624-57db-a258-dd1855d4a417 with identifier: 20470703
2026-03-29 20:27:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fad4611a-c624-57db-a258-dd1855d4a417 with identifier: 20470703 to the API
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_driver-1774692748618.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fad4611a-c624-57db-a258-dd1855d4a417',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YD71 BYX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20470703',
'listing': 'auction',
'location': 'Inverclyde Kilmacolm',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 28100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1427834,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_driver-1774692748618.jpg',
'Width': 3326},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757108,
'Height': 2600,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_driver-1774692744004.jpg',
'Width': 3466},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211227,
'Height': 2241,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_front_passenger-1774692757490.jpg',
'Width': 2988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1699731,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/20470703/exterior_rear_passenger-1774692742114.jpg',
'Width': 3746},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1889354,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0703/20470703/interior_front_seats-1774693301437.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2183235,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0703/20470703/interior_rear_seats-1774693297996.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1837121,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0703/20470703/interior_dashboard-1774694703285.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2656382,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0703/20470703/interior_boot-1774693291150.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938971,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694940725.jpg?ixlib=js-3.8.0&auto=format&s=6194bb3165fc90853793f9b623a6e71f',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad4611a-c624-57db-a258-dd1855d4a417/fad4611a-c624-57db-a258-dd1855d4a417_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170440,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0703/20470703/docs_service_history-1774694957984.jpg?ixlib=js-3.8.0&auto=format&s=9561e13722ddba1b71d2ed2046c43509',
'Width': 3840}],
'price': 24400,
'price_includes_vat': False,
'registration_date': '2021-09-21',
'seats_number': None,
'seller_name': None,
'title': 'Cupra Formentor VZ2 TSI 4DRIVE S-A',
'transmission': 'automatic',
'trim': 'VZ2 TSI 4DRIVE S-A',
'vin': 'VSSZZZKMZNR004655',
'year': 2021}
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470703%27 HTTP/1.1" 200 None
2026-03-29 20:27:28 [motorway.uk] INFO: Saving data for 20470703: {'created_time': 1774816048.621539, 'last_price_update_time': 1774816048.621548, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20470703') HTTP/1.1" 204 0
2026-03-29 20:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_passenger-1774618677970.jpg> (referer: None)
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1f390>
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_rear_passenger-1774618677970.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_passenger-1774618677970.jpg saved to cache
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16548854.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_passenger-1774618710747.jpg> (referer: None)
2026-03-29 20:27:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b6c108b-36d1-5afe-a00d-466d8dca6ecb with identifier: 16548854
2026-03-29 20:27:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb with scrape type 1
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_front_driver-1774618747443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_driver-1774618747443.jpg not downloaded yet
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_rear_driver-1774618915402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_driver-1774618915402.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_front_passenger-1774618744171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_passenger-1774618744171.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_rear_passenger-1774618959523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_passenger-1774618959523.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8854%252F16548854%252Finterior_front_seats-1774621052776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8854/16548854/interior_front_seats-1774621052776.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8854%252F16548854%252Finterior_rear_seats-1774687751607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8854/16548854/interior_rear_seats-1774687751607.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Finterior_dashboard-1774625474813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/interior_dashboard-1774625474813.jpg not downloaded yet
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3f9710>
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_front_passenger-1774618710747.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_passenger-1774618710747.jpg saved to cache
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8854%252F16548854%252Finstrument_cluster-1774631624759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8854/16548854/instrument_cluster-1774631624759.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8854%252F16548854%252Finterior_boot-1774621057819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8854/16548854/interior_boot-1774621057819.jpg not downloaded yet
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8854%252F16548854%252Fdocs_service_history-1774687758089.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6603c0f580925ad0afd244ba1bc3a4c0%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8854/16548854/docs_service_history-1774687758089.jpg?ixlib=js-3.8.0&auto=format&s=6603c0f580925ad0afd244ba1bc3a4c0 not downloaded yet
2026-03-29 20:27:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_driver-1774618852016.jpg> (referer: None)
2026-03-29 20:27:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_driver-1774618654841.jpg> (referer: None)
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c666690>
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_front_driver-1774618852016.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_driver-1774618852016.jpg saved to cache
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c667390>
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8099%252F20028099%252Fexterior_rear_driver-1774618654841.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_driver-1774618654841.jpg saved to cache
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1
2026-03-29 20:27:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19dc3fd4-b821-5f40-9da1-e35214e14ff1, skipping ID generation
2026-03-29 20:27:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1 with scrape type 1
2026-03-29 20:27:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19dc3fd4-b821-5f40-9da1-e35214e14ff1 sending to next pipeline
2026-03-29 20:27:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 19dc3fd4-b821-5f40-9da1-e35214e14ff1, identifier: 20028099
2026-03-29 20:27:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 19dc3fd4-b821-5f40-9da1-e35214e14ff1 with identifier: 20028099
2026-03-29 20:27:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 19dc3fd4-b821-5f40-9da1-e35214e14ff1 with identifier: 20028099
2026-03-29 20:27:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 19dc3fd4-b821-5f40-9da1-e35214e14ff1 with identifier: 20028099 to the API
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_driver-1774618654841.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '19dc3fd4-b821-5f40-9da1-e35214e14ff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MC73 PNN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20028099',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 20025,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1146934,
'Height': 1901,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_driver-1774618852016.jpg',
'Width': 2535},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115777,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_driver-1774618654841.jpg',
'Width': 3562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2019511,
'Height': 2677,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_front_passenger-1774618710747.jpg',
'Width': 3569},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2166410,
'Height': 2868,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8099/20028099/exterior_rear_passenger-1774618677970.jpg',
'Width': 3824},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3170256,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8099/20028099/interior_front_seats-1774619870786.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2860998,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8099/20028099/interior_rear_seats-1774619859056.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1736849,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8099/20028099/interior_dashboard-1774619862378.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310045,
'Height': 1022,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8099/20028099/instrument_cluster-1774620907115.jpg',
'Width': 1363},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2435832,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8099/20028099/interior_boot-1774619920439.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19dc3fd4-b821-5f40-9da1-e35214e14ff1/19dc3fd4-b821-5f40-9da1-e35214e14ff1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218385,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8099/20028099/docs_service_history-1774775693482.jpg?ixlib=js-3.8.0&auto=format&s=acfe5ad9d0cc86db68aa50a8b4a653b8',
'Width': 1080}],
'price': 16939,
'price_includes_vat': False,
'registration_date': '2023-12-29',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-CROSS Black Edition TSI S-A',
'transmission': 'automatic',
'trim': 'T-CROSS Black Edition TSI S-A',
'vin': 'WVGZZZC10PY179699',
'year': 2023}
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720028099%27 HTTP/1.1" 200 None
2026-03-29 20:27:29 [motorway.uk] INFO: Saving data for 20028099: {'created_time': 1774816049.99499, 'last_price_update_time': 1774816049.995002, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20028099') HTTP/1.1" 204 0
2026-03-29 20:27:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=972&page=27&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8854/16548854/interior_boot-1774621057819.jpg> (referer: None)
2026-03-29 20:27:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8854/16548854/docs_service_history-1774687758089.jpg?ixlib=js-3.8.0&auto=format&s=6603c0f580925ad0afd244ba1bc3a4c0> (referer: None)
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20411853
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 18697582
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 3263792
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20388810
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20267620
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20355104
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 16997942
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20235987
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235987%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20235987: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20327167
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720327167%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20327167: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 18355209
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718355209%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 18355209: 1
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1ab2d0>
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8854%252F16548854%252Finterior_boot-1774621057819.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8854/16548854/interior_boot-1774621057819.jpg saved to cache
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20500674
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500674%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20500674: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20417268
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20488448
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 4592998
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20289196
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 17884848
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20406554
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406554%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20406554: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20396431
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20479789
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20496248
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496248%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20496248: 1
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xa0'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xb8'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: BitsPerSample (258) - type: short (3) Tag Location: 46 - Data Location: 218 - value: b'\x00\x08\x00\x08\x00\x08'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 158 - value: b'HONOR\x00'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 70 - Data Location: 164 - value: b'ALI-NX1\x00'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 172 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 188 - value: b'ALI-N21 9.0.0.191(C431E5R3P1)\x00'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 224 - value: b'2026:03:27 17:24:32\x00'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xf4'
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071190>
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8854%252F16548854%252Fdocs_service_history-1774687758089.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6603c0f580925ad0afd244ba1bc3a4c0') HTTP/1.1" 204 0
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8854/16548854/docs_service_history-1774687758089.jpg?ixlib=js-3.8.0&auto=format&s=6603c0f580925ad0afd244ba1bc3a4c0 saved to cache
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 16533872
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20491744
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491744%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20491744: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 19390207
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20065341
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20491588
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 19412192
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 8144237
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20178701
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720178701%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20178701: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 9608672
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20487398
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20473693
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 19953302
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20149199
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20426141
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426141%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 20426141: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 10536049
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710536049%27 HTTP/1.1" 200 None
2026-03-29 20:27:30 [motorway.uk] INFO: Scrape type for 10536049: 1
2026-03-29 20:27:30 [motorway.uk] INFO: Found listing with ID: 20307524
2026-03-29 20:27:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8854/16548854/instrument_cluster-1774631624759.jpg> (referer: None)
2026-03-29 20:27:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8854/16548854/interior_dashboard-1774625474813.jpg> (referer: None)
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1a8890>
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8854%252F16548854%252Finstrument_cluster-1774631624759.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8854/16548854/instrument_cluster-1774631624759.jpg saved to cache
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4f510>
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Finterior_dashboard-1774625474813.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/interior_dashboard-1774625474813.jpg saved to cache
2026-03-29 20:27:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20052855.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469298.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa5df884-e2c5-5a72-a24f-6be62ed35889 with identifier: 20052855
2026-03-29 20:27:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa5df884-e2c5-5a72-a24f-6be62ed35889 with scrape type 1
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Fexterior_front_driver-1774700330258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/exterior_front_driver-1774700330258.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Fexterior_rear_driver-1774700340495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/exterior_rear_driver-1774700340495.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2855%252F20052855%252Fexterior_front_passenger-1774525216132.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_front_passenger-1774525216132.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2855%252F20052855%252Fexterior_rear_passenger-1774699637258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_rear_passenger-1774699637258.jpg not downloaded yet
2026-03-29 20:27:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b1c0af-d835-5ad3-bd5c-37a29c72b77d with identifier: 20469298
2026-03-29 20:27:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d with scrape type 1
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_front_driver-1774781647533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_driver-1774781647533.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2855%252F20052855%252Finterior_front_seats-1774698163417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2855/20052855/interior_front_seats-1774698163417.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_rear_driver-1774782684078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_driver-1774782684078.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2855%252F20052855%252Finterior_rear_seats-1774698353371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2855/20052855/interior_rear_seats-1774698353371.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_front_passenger-1774781753428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_passenger-1774781753428.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Finterior_dashboard-1774700361667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/interior_dashboard-1774700361667.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_rear_passenger-1774782801167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_passenger-1774782801167.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Finstrument_cluster-1774700431532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/instrument_cluster-1774700431532.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Finterior_front_seats-1774781580135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/interior_front_seats-1774781580135.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2855%252F20052855%252Finterior_boot-1774698687936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2855/20052855/interior_boot-1774698687936.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9298%252F20469298%252Finterior_rear_seats-1774779243107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9298/20469298/interior_rear_seats-1774779243107.jpg not downloaded yet
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2855%252F20052855%252Fdocs_service_history-1774698969617.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6ca1cd7da9912d7f9b2772fa2cbe4b9%27 HTTP/1.1" 200 None
2026-03-29 20:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2855/20052855/docs_service_history-1774698969617.jpg?ixlib=js-3.8.0&auto=format&s=c6ca1cd7da9912d7f9b2772fa2cbe4b9 not downloaded yet
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Finterior_dashboard-1774782838663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/interior_dashboard-1774782838663.jpg not downloaded yet
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9298%252F20469298%252Finterior_boot-1774779328194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9298/20469298/interior_boot-1774779328194.jpg not downloaded yet
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fdamage_missing_trims-1774781823139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774781823139.jpg not downloaded yet
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fdamage_missing_trims-1774782767953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774782767953.jpg not downloaded yet
2026-03-29 20:27:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20436077.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53245fc1-f565-5c2e-b37c-05e1d852a66f with identifier: 20436077
2026-03-29 20:27:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53245fc1-f565-5c2e-b37c-05e1d852a66f with scrape type 1
2026-03-29 20:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_front_driver-1774642104586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_driver-1774642104586.jpg not downloaded yet
2026-03-29 20:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_rear_driver-1774642108826.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_driver-1774642108826.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_front_passenger-1774642118795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_passenger-1774642118795.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_rear_passenger-1774642115716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_passenger-1774642115716.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6077%252F20436077%252Finterior_front_seats-1774643465533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6077/20436077/interior_front_seats-1774643465533.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6077%252F20436077%252Finterior_rear_seats-1774644743389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6077/20436077/interior_rear_seats-1774644743389.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6077%252F20436077%252Finterior_dashboard-1774690741606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6077/20436077/interior_dashboard-1774690741606.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Finstrument_cluster-1774643066006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/instrument_cluster-1774643066006.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6077%252F20436077%252Finterior_boot-1774643163914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6077/20436077/interior_boot-1774643163914.jpg not downloaded yet
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6077%252F20436077%252Fdocs_service_history-1774645169682.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2c2212a930f04c3b0788abd9c5b162e2%27 HTTP/1.1" 200 None
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6077/20436077/docs_service_history-1774645169682.jpg?ixlib=js-3.8.0&auto=format&s=2c2212a930f04c3b0788abd9c5b162e2 not downloaded yet
2026-03-29 20:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774782767953.jpg> (referer: None)
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21c450>
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fdamage_missing_trims-1774782767953.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774782767953.jpg saved to cache
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:27:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6077/20436077/docs_service_history-1774645169682.jpg?ixlib=js-3.8.0&auto=format&s=2c2212a930f04c3b0788abd9c5b162e2> (referer: None)
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca24f90>
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6077%252F20436077%252Fdocs_service_history-1774645169682.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2c2212a930f04c3b0788abd9c5b162e2') HTTP/1.1" 204 0
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6077/20436077/docs_service_history-1774645169682.jpg?ixlib=js-3.8.0&auto=format&s=2c2212a930f04c3b0788abd9c5b162e2 saved to cache
2026-03-29 20:27:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6077/20436077/interior_boot-1774643163914.jpg> (referer: None)
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00f7d0>
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6077%252F20436077%252Finterior_boot-1774643163914.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6077/20436077/interior_boot-1774643163914.jpg saved to cache
2026-03-29 20:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6077/20436077/instrument_cluster-1774643066006.jpg> (referer: None)
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca25e90>
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Finstrument_cluster-1774643066006.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/instrument_cluster-1774643066006.jpg saved to cache
2026-03-29 20:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6077/20436077/interior_dashboard-1774690741606.jpg> (referer: None)
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9ba010>
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6077%252F20436077%252Finterior_dashboard-1774690741606.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6077/20436077/interior_dashboard-1774690741606.jpg saved to cache
2026-03-29 20:27:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6077/20436077/interior_rear_seats-1774644743389.jpg> (referer: None)
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca24650>
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6077%252F20436077%252Finterior_rear_seats-1774644743389.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6077/20436077/interior_rear_seats-1774644743389.jpg saved to cache
2026-03-29 20:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6077/20436077/interior_front_seats-1774643465533.jpg> (referer: None)
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2dbd0>
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6077%252F20436077%252Finterior_front_seats-1774643465533.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6077/20436077/interior_front_seats-1774643465533.jpg saved to cache
2026-03-29 20:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_passenger-1774642115716.jpg> (referer: None)
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22e2d0>
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_rear_passenger-1774642115716.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_passenger-1774642115716.jpg saved to cache
2026-03-29 20:27:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_passenger-1774642118795.jpg> (referer: None)
2026-03-29 20:27:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20502804.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d025290>
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_front_passenger-1774642118795.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_passenger-1774642118795.jpg saved to cache
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 with identifier: 20502804
2026-03-29 20:27:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 with scrape type 1
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_front_driver-1774785736418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_driver-1774785736418.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_rear_driver-1774785781356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_driver-1774785781356.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_front_passenger-1774785737426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_passenger-1774785737426.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_rear_passenger-1774785740589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_passenger-1774785740589.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2804%252F20502804%252Finterior_front_seats-1774786526277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2804/20502804/interior_front_seats-1774786526277.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2804%252F20502804%252Finterior_rear_seats-1774786528916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2804/20502804/interior_rear_seats-1774786528916.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2804%252F20502804%252Finterior_dashboard-1774787196527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2804/20502804/interior_dashboard-1774787196527.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2804%252F20502804%252Finterior_boot-1774786530530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2804/20502804/interior_boot-1774786530530.jpg not downloaded yet
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2804%252F20502804%252Fdocs_service_history-1774786721082.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df98b0dee96b94e0334662600ba044511%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786721082.jpg?ixlib=js-3.8.0&auto=format&s=f98b0dee96b94e0334662600ba044511 not downloaded yet
2026-03-29 20:27:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_driver-1774642108826.jpg> (referer: None)
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2804%252F20502804%252Fdocs_service_history-1774786760342.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0ea85fae4a963154f759c5e9528f587%27 HTTP/1.1" 200 None
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786760342.jpg?ixlib=js-3.8.0&auto=format&s=d0ea85fae4a963154f759c5e9528f587 not downloaded yet
2026-03-29 20:27:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_driver-1774642104586.jpg> (referer: None)
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b5310>
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_rear_driver-1774642108826.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_driver-1774642108826.jpg saved to cache
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b4650>
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6077%252F20436077%252Fexterior_front_driver-1774642104586.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_driver-1774642104586.jpg saved to cache
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53245fc1-f565-5c2e-b37c-05e1d852a66f
2026-03-29 20:27:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53245fc1-f565-5c2e-b37c-05e1d852a66f, skipping ID generation
2026-03-29 20:27:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53245fc1-f565-5c2e-b37c-05e1d852a66f with scrape type 1
2026-03-29 20:27:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53245fc1-f565-5c2e-b37c-05e1d852a66f sending to next pipeline
2026-03-29 20:27:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 53245fc1-f565-5c2e-b37c-05e1d852a66f, identifier: 20436077
2026-03-29 20:27:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 53245fc1-f565-5c2e-b37c-05e1d852a66f with identifier: 20436077
2026-03-29 20:27:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 53245fc1-f565-5c2e-b37c-05e1d852a66f with identifier: 20436077
2026-03-29 20:27:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 53245fc1-f565-5c2e-b37c-05e1d852a66f with identifier: 20436077 to the API
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_driver-1774642104586.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '53245fc1-f565-5c2e-b37c-05e1d852a66f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AU68 PBV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20436077',
'listing': 'auction',
'location': 'Norfolk Thetford',
'make': 'SEAT',
'model': 'Ibiza',
'odometer': 65553,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1316593,
'Height': 2743,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_driver-1774642104586.jpg',
'Width': 3657},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1123119,
'Height': 2469,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_driver-1774642108826.jpg',
'Width': 3292},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1093682,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_front_passenger-1774642118795.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238340,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6077/20436077/exterior_rear_passenger-1774642115716.jpg',
'Width': 3442},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1854923,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6077/20436077/interior_front_seats-1774643465533.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2384689,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6077/20436077/interior_rear_seats-1774644743389.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2126026,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6077/20436077/interior_dashboard-1774690741606.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1767578,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6077/20436077/instrument_cluster-1774643066006.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3998381,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6077/20436077/interior_boot-1774643163914.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53245fc1-f565-5c2e-b37c-05e1d852a66f/53245fc1-f565-5c2e-b37c-05e1d852a66f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 714894,
'Height': 3251,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6077/20436077/docs_service_history-1774645169682.jpg?ixlib=js-3.8.0&auto=format&s=2c2212a930f04c3b0788abd9c5b162e2',
'Width': 2317}],
'price': 7286,
'price_includes_vat': False,
'registration_date': '2018-09-23',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Ibiza FR TSI',
'transmission': 'manual',
'trim': 'FR TSI',
'vin': 'VSSZZZKJZKR004163',
'year': 2018}
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436077%27 HTTP/1.1" 200 None
2026-03-29 20:27:37 [motorway.uk] INFO: Saving data for 20436077: {'created_time': 1774816057.32157, 'last_price_update_time': 1774816057.32158, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20436077') HTTP/1.1" 204 0
2026-03-29 20:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786721082.jpg?ixlib=js-3.8.0&auto=format&s=f98b0dee96b94e0334662600ba044511> (referer: None)
2026-03-29 20:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786760342.jpg?ixlib=js-3.8.0&auto=format&s=d0ea85fae4a963154f759c5e9528f587> (referer: None)
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1bdd0>
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2804%252F20502804%252Fdocs_service_history-1774786721082.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df98b0dee96b94e0334662600ba044511') HTTP/1.1" 204 0
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786721082.jpg?ixlib=js-3.8.0&auto=format&s=f98b0dee96b94e0334662600ba044511 saved to cache
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13d890>
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2804%252F20502804%252Fdocs_service_history-1774786760342.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0ea85fae4a963154f759c5e9528f587') HTTP/1.1" 204 0
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786760342.jpg?ixlib=js-3.8.0&auto=format&s=d0ea85fae4a963154f759c5e9528f587 saved to cache
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19871523.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2804/20502804/interior_dashboard-1774787196527.jpg> (referer: None)
2026-03-29 20:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2804/20502804/interior_boot-1774786530530.jpg> (referer: None)
2026-03-29 20:27:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adbd258f-fee9-52fa-9ef8-ebee9030c5f9 with identifier: 19871523
2026-03-29 20:27:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9 with scrape type 1
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_front_driver-1774006969906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_driver-1774006969906.jpg not downloaded yet
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_rear_driver-1774006984871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_driver-1774006984871.jpg not downloaded yet
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_front_passenger-1774007008169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_passenger-1774007008169.jpg not downloaded yet
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_rear_passenger-1774006993769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_passenger-1774006993769.jpg not downloaded yet
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58e2d0>
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2804%252F20502804%252Finterior_dashboard-1774787196527.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2804/20502804/interior_dashboard-1774787196527.jpg saved to cache
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c65a010>
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2804%252F20502804%252Finterior_boot-1774786530530.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2804/20502804/interior_boot-1774786530530.jpg saved to cache
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1523%252F19871523%252Finterior_front_seats-1774007303029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1523/19871523/interior_front_seats-1774007303029.jpg not downloaded yet
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1523%252F19871523%252Finterior_rear_seats-1774007318345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1523/19871523/interior_rear_seats-1774007318345.jpg not downloaded yet
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1523%252F19871523%252Finterior_dashboard-1774351393732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1523/19871523/interior_dashboard-1774351393732.jpg not downloaded yet
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Finstrument_cluster-1774007382926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/instrument_cluster-1774007382926.jpg not downloaded yet
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1523%252F19871523%252Finterior_boot-1774007359370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1523/19871523/interior_boot-1774007359370.jpg not downloaded yet
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1523%252F19871523%252Fdocs_service_history-1774009011232.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6bbbee919da0b744a6e6da4f39a8fa7b%27 HTTP/1.1" 200 None
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1523/19871523/docs_service_history-1774009011232.jpg?ixlib=js-3.8.0&auto=format&s=6bbbee919da0b744a6e6da4f39a8fa7b not downloaded yet
2026-03-29 20:27:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_passenger-1774785740589.jpg> (referer: None)
2026-03-29 20:27:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2804/20502804/interior_front_seats-1774786526277.jpg> (referer: None)
2026-03-29 20:27:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2804/20502804/interior_rear_seats-1774786528916.jpg> (referer: None)
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d08e310>
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_rear_passenger-1774785740589.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_passenger-1774785740589.jpg saved to cache
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d08c1d0>
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2804%252F20502804%252Finterior_front_seats-1774786526277.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2804/20502804/interior_front_seats-1774786526277.jpg saved to cache
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf5b10>
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2804%252F20502804%252Finterior_rear_seats-1774786528916.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2804/20502804/interior_rear_seats-1774786528916.jpg saved to cache
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1523/19871523/docs_service_history-1774009011232.jpg?ixlib=js-3.8.0&auto=format&s=6bbbee919da0b744a6e6da4f39a8fa7b> (referer: None)
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c272790>
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1523%252F19871523%252Fdocs_service_history-1774009011232.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6bbbee919da0b744a6e6da4f39a8fa7b') HTTP/1.1" 204 0
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1523/19871523/docs_service_history-1774009011232.jpg?ixlib=js-3.8.0&auto=format&s=6bbbee919da0b744a6e6da4f39a8fa7b saved to cache
2026-03-29 20:27:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1523/19871523/interior_boot-1774007359370.jpg> (referer: None)
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbeb5d0>
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1523%252F19871523%252Finterior_boot-1774007359370.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1523/19871523/interior_boot-1774007359370.jpg saved to cache
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1523/19871523/interior_dashboard-1774351393732.jpg> (referer: None)
2026-03-29 20:27:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1523/19871523/instrument_cluster-1774007382926.jpg> (referer: None)
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c270450>
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1523%252F19871523%252Finterior_dashboard-1774351393732.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1523/19871523/interior_dashboard-1774351393732.jpg saved to cache
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbea650>
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Finstrument_cluster-1774007382926.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/instrument_cluster-1774007382926.jpg saved to cache
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_passenger-1774006993769.jpg> (referer: None)
2026-03-29 20:27:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1523/19871523/interior_front_seats-1774007303029.jpg> (referer: None)
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c270410>
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_rear_passenger-1774006993769.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_passenger-1774006993769.jpg saved to cache
2026-03-29 20:27:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9d510>
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1523%252F19871523%252Finterior_front_seats-1774007303029.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1523/19871523/interior_front_seats-1774007303029.jpg saved to cache
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1523/19871523/interior_rear_seats-1774007318345.jpg> (referer: None)
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_passenger-1774007008169.jpg> (referer: None)
2026-03-29 20:27:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce224d0>
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1523%252F19871523%252Finterior_rear_seats-1774007318345.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1523/19871523/interior_rear_seats-1774007318345.jpg saved to cache
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce20f10>
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_front_passenger-1774007008169.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_passenger-1774007008169.jpg saved to cache
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490281.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_driver-1774006984871.jpg> (referer: None)
2026-03-29 20:27:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 with identifier: 20490281
2026-03-29 20:27:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 with scrape type 1
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_front_driver-1774710240610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_driver-1774710240610.jpg not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_rear_driver-1774710137742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_driver-1774710137742.jpg not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_front_passenger-1774710175033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_passenger-1774710175033.jpg not downloaded yet
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a0110>
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_rear_driver-1774006984871.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_driver-1774006984871.jpg saved to cache
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_rear_passenger-1774710152331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_passenger-1774710152331.jpg not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0281%252F20490281%252Finterior_front_seats-1774710715000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0281/20490281/interior_front_seats-1774710715000.jpg not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0281%252F20490281%252Finterior_rear_seats-1774710933460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0281/20490281/interior_rear_seats-1774710933460.jpg not downloaded yet
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_driver-1774785736418.jpg> (referer: None)
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0281%252F20490281%252F20490281-interior_dashboard-modified-1774711796743.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0281/20490281/20490281-interior_dashboard-modified-1774711796743.jpeg not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0281%252F20490281%252Finterior_boot-1774710806203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0281/20490281/interior_boot-1774710806203.jpg not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0281%252F20490281%252Fdocs_service_history-1774711100173.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D280cac155f05bfe2e7f4460d444c4e5a%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711100173.jpg?ixlib=js-3.8.0&auto=format&s=280cac155f05bfe2e7f4460d444c4e5a not downloaded yet
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0281%252F20490281%252Fdocs_service_history-1774711135052.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db365ce11fc7009f1993fbaff76444d2a%27 HTTP/1.1" 200 None
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711135052.jpg?ixlib=js-3.8.0&auto=format&s=b365ce11fc7009f1993fbaff76444d2a not downloaded yet
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_driver-1774785781356.jpg> (referer: None)
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d118c10>
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_front_driver-1774785736418.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_driver-1774785736418.jpg saved to cache
2026-03-29 20:27:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_passenger-1774785737426.jpg> (referer: None)
2026-03-29 20:27:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_driver-1774006969906.jpg> (referer: None)
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0260d0>
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_rear_driver-1774785781356.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_driver-1774785781356.jpg saved to cache
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e9910>
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2804%252F20502804%252Fexterior_front_passenger-1774785737426.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_passenger-1774785737426.jpg saved to cache
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7
2026-03-29 20:27:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c91b9293-1f4b-56c6-84a0-8da5d3d4fee7, skipping ID generation
2026-03-29 20:27:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 with scrape type 1
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 sending to next pipeline
2026-03-29 20:27:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c91b9293-1f4b-56c6-84a0-8da5d3d4fee7, identifier: 20502804
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11a150>
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1523%252F19871523%252Fexterior_front_driver-1774006969906.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_driver-1774006969906.jpg saved to cache
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9
2026-03-29 20:27:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adbd258f-fee9-52fa-9ef8-ebee9030c5f9, skipping ID generation
2026-03-29 20:27:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9 with scrape type 1
2026-03-29 20:27:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adbd258f-fee9-52fa-9ef8-ebee9030c5f9 sending to next pipeline
2026-03-29 20:27:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: adbd258f-fee9-52fa-9ef8-ebee9030c5f9, identifier: 19871523
2026-03-29 20:27:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 with identifier: 20502804
2026-03-29 20:27:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 with identifier: 20502804
2026-03-29 20:27:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c91b9293-1f4b-56c6-84a0-8da5d3d4fee7 with identifier: 20502804 to the API
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_passenger-1774785737426.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c91b9293-1f4b-56c6-84a0-8da5d3d4fee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KM63 ZXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20502804',
'listing': 'auction',
'location': 'Northamptonshire Kettering',
'make': 'Renault',
'model': 'Megane',
'odometer': 74591,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710572,
'Height': 1904,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_driver-1774785736418.jpg',
'Width': 2538},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1330058,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_driver-1774785781356.jpg',
'Width': 3771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392490,
'Height': 2558,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_front_passenger-1774785737426.jpg',
'Width': 3411},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635059,
'Height': 2870,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2804/20502804/exterior_rear_passenger-1774785740589.jpg',
'Width': 3826},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2897696,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2804/20502804/interior_front_seats-1774786526277.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4971212,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2804/20502804/interior_rear_seats-1774786528916.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1668609,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2804/20502804/interior_dashboard-1774787196527.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2707441,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2804/20502804/interior_boot-1774786530530.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207715,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786721082.jpg?ixlib=js-3.8.0&auto=format&s=f98b0dee96b94e0334662600ba044511',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91b9293-1f4b-56c6-84a0-8da5d3d4fee7/c91b9293-1f4b-56c6-84a0-8da5d3d4fee7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1349756,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2804/20502804/docs_service_history-1774786760342.jpg?ixlib=js-3.8.0&auto=format&s=d0ea85fae4a963154f759c5e9528f587',
'Width': 3840}],
'price': 1466,
'price_includes_vat': False,
'registration_date': '2013-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Renault Megane D-QUE TT Energy DCI S/S',
'transmission': 'manual',
'trim': 'D-QUE TT Energy DCI S/S',
'vin': 'VF1BZ140649726472',
'year': 2013}
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720502804%27 HTTP/1.1" 200 None
2026-03-29 20:27:41 [motorway.uk] INFO: Saving data for 20502804: {'created_time': 1774816061.950947, 'last_price_update_time': 1774816061.950967, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20502804') HTTP/1.1" 204 0
2026-03-29 20:27:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: adbd258f-fee9-52fa-9ef8-ebee9030c5f9 with identifier: 19871523
2026-03-29 20:27:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: adbd258f-fee9-52fa-9ef8-ebee9030c5f9 with identifier: 19871523
2026-03-29 20:27:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: adbd258f-fee9-52fa-9ef8-ebee9030c5f9 with identifier: 19871523 to the API
2026-03-29 20:27:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_driver-1774006969906.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'adbd258f-fee9-52fa-9ef8-ebee9030c5f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'CY19 MLV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19871523',
'listing': 'auction',
'location': 'West Yorkshire Halifax',
'make': 'Volkswagen',
'model': 'Transporter',
'odometer': 52739,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1908861,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_driver-1774006969906.jpg',
'Width': 3191},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1727982,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_driver-1774006984871.jpg',
'Width': 3283},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1818910,
'Height': 2463,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_front_passenger-1774007008169.jpg',
'Width': 3284},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1618190,
'Height': 2365,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1523/19871523/exterior_rear_passenger-1774006993769.jpg',
'Width': 3153},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4109098,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1523/19871523/interior_front_seats-1774007303029.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5269546,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1523/19871523/interior_rear_seats-1774007318345.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2082828,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1523/19871523/interior_dashboard-1774351393732.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2778594,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1523/19871523/instrument_cluster-1774007382926.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4817039,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1523/19871523/interior_boot-1774007359370.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd258f-fee9-52fa-9ef8-ebee9030c5f9/adbd258f-fee9-52fa-9ef8-ebee9030c5f9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711644,
'Height': 3175,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1523/19871523/docs_service_history-1774009011232.jpg?ixlib=js-3.8.0&auto=format&s=6bbbee919da0b744a6e6da4f39a8fa7b',
'Width': 2177}],
'price': 18519,
'price_includes_vat': False,
'registration_date': '2019-07-03',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Transporter T32 H-LN TDI BMT',
'transmission': 'manual',
'trim': 'T32 H-LN TDI BMT',
'vin': 'WV1ZZZ7HZKH081348',
'year': 2019}
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719871523%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [motorway.uk] INFO: Saving data for 19871523: {'created_time': 1774816063.072773, 'last_price_update_time': 1774816063.072783, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19871523') HTTP/1.1" 204 0
2026-03-29 20:27:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711135052.jpg?ixlib=js-3.8.0&auto=format&s=b365ce11fc7009f1993fbaff76444d2a> (referer: None)
2026-03-29 20:27:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0281/20490281/interior_rear_seats-1774710933460.jpg> (referer: None)
2026-03-29 20:27:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0281/20490281/interior_boot-1774710806203.jpg> (referer: None)
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119850>
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0281%252F20490281%252Fdocs_service_history-1774711135052.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db365ce11fc7009f1993fbaff76444d2a') HTTP/1.1" 204 0
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711135052.jpg?ixlib=js-3.8.0&auto=format&s=b365ce11fc7009f1993fbaff76444d2a saved to cache
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500674.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce4a010>
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0281%252F20490281%252Finterior_rear_seats-1774710933460.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0281/20490281/interior_rear_seats-1774710933460.jpg saved to cache
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed79790>
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0281%252F20490281%252Finterior_boot-1774710806203.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0281/20490281/interior_boot-1774710806203.jpg saved to cache
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cc720d-8eab-54bc-ba82-044f2f5dc847 with identifier: 20500674
2026-03-29 20:27:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cc720d-8eab-54bc-ba82-044f2f5dc847 with scrape type 1
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Fexterior_front_driver-1774784071103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_driver-1774784071103.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Fexterior_rear_driver-1774784083945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/exterior_rear_driver-1774784083945.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Fexterior_front_passenger-1774784097670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_passenger-1774784097670.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0674%252F20500674%252Fexterior_rear_passenger-1774782211280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0674/20500674/exterior_rear_passenger-1774782211280.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0674%252F20500674%252Finterior_front_seats-1774783133023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0674/20500674/interior_front_seats-1774783133023.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0674%252F20500674%252Finterior_rear_seats-1774783059646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0674/20500674/interior_rear_seats-1774783059646.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Finterior_dashboard-1774784056003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/interior_dashboard-1774784056003.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0674%252F20500674%252Finterior_boot-1774783094699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0674/20500674/interior_boot-1774783094699.jpg not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0674%252F20500674%252Fdocs_service_history-1774783554817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ed71f8bea6467a335c72c3fc4058930%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783554817.jpg?ixlib=js-3.8.0&auto=format&s=3ed71f8bea6467a335c72c3fc4058930 not downloaded yet
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0674%252F20500674%252Fdocs_service_history-1774783555564.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D61c371e694c2c4fa9c4ea8fb95c07fc9%27 HTTP/1.1" 200 None
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783555564.jpg?ixlib=js-3.8.0&auto=format&s=61c371e694c2c4fa9c4ea8fb95c07fc9 not downloaded yet
2026-03-29 20:27:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0281/20490281/20490281-interior_dashboard-modified-1774711796743.jpeg> (referer: None)
2026-03-29 20:27:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711100173.jpg?ixlib=js-3.8.0&auto=format&s=280cac155f05bfe2e7f4460d444c4e5a> (referer: None)
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01e510>
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0281%252F20490281%252F20490281-interior_dashboard-modified-1774711796743.jpeg') HTTP/1.1" 204 0
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0281/20490281/20490281-interior_dashboard-modified-1774711796743.jpeg saved to cache
2026-03-29 20:27:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d040e10>
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0281%252F20490281%252Fdocs_service_history-1774711100173.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D280cac155f05bfe2e7f4460d444c4e5a') HTTP/1.1" 204 0
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711100173.jpg?ixlib=js-3.8.0&auto=format&s=280cac155f05bfe2e7f4460d444c4e5a saved to cache
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783554817.jpg?ixlib=js-3.8.0&auto=format&s=3ed71f8bea6467a335c72c3fc4058930> (referer: None)
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0281/20490281/interior_front_seats-1774710715000.jpg> (referer: None)
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_passenger-1774710175033.jpg> (referer: None)
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783555564.jpg?ixlib=js-3.8.0&auto=format&s=61c371e694c2c4fa9c4ea8fb95c07fc9> (referer: None)
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07e590>
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0674%252F20500674%252Fdocs_service_history-1774783554817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ed71f8bea6467a335c72c3fc4058930') HTTP/1.1" 204 0
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783554817.jpg?ixlib=js-3.8.0&auto=format&s=3ed71f8bea6467a335c72c3fc4058930 saved to cache
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d739490>
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0281%252F20490281%252Finterior_front_seats-1774710715000.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0281/20490281/interior_front_seats-1774710715000.jpg saved to cache
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f19490>
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_front_passenger-1774710175033.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_passenger-1774710175033.jpg saved to cache
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d01ca50>
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0674%252F20500674%252Fdocs_service_history-1774783555564.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D61c371e694c2c4fa9c4ea8fb95c07fc9') HTTP/1.1" 204 0
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783555564.jpg?ixlib=js-3.8.0&auto=format&s=61c371e694c2c4fa9c4ea8fb95c07fc9 saved to cache
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1008&page=28&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0674/20500674/interior_dashboard-1774784056003.jpg> (referer: None)
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_passenger-1774710152331.jpg> (referer: None)
2026-03-29 20:27:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0674/20500674/interior_boot-1774783094699.jpg> (referer: None)
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 20304692
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 15783679
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715783679%27 HTTP/1.1" 200 None
2026-03-29 20:27:44 [motorway.uk] INFO: Scrape type for 15783679: 1
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 17667845
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 17291886
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717291886%27 HTTP/1.1" 200 None
2026-03-29 20:27:44 [motorway.uk] INFO: Scrape type for 17291886: 1
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 17331311
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 20377284
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 18264016
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718264016%27 HTTP/1.1" 200 None
2026-03-29 20:27:44 [motorway.uk] INFO: Scrape type for 18264016: 1
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 20486192
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 20489798
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 18016902
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 20194798
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 19772114
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719772114%27 HTTP/1.1" 200 None
2026-03-29 20:27:44 [motorway.uk] INFO: Scrape type for 19772114: 1
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d041310>
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Finterior_dashboard-1774784056003.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/interior_dashboard-1774784056003.jpg saved to cache
2026-03-29 20:27:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 20365288
2026-03-29 20:27:44 [motorway.uk] INFO: Found listing with ID: 19121650
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719121650%27 HTTP/1.1" 200 None
2026-03-29 20:27:44 [motorway.uk] INFO: Scrape type for 19121650: 1
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9fc50>
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_rear_passenger-1774710152331.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_passenger-1774710152331.jpg saved to cache
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 13570427
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713570427%27 HTTP/1.1" 200 None
2026-03-29 20:27:45 [motorway.uk] INFO: Scrape type for 13570427: 1
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 13327562
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 17966792
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20229861
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20471278
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471278%27 HTTP/1.1" 200 None
2026-03-29 20:27:45 [motorway.uk] INFO: Scrape type for 20471278: 1
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed9b850>
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0674%252F20500674%252Finterior_boot-1774783094699.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0674/20500674/interior_boot-1774783094699.jpg saved to cache
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20454392
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20165611
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 19472539
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20422592
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20385998
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 16437364
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20369773
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 18202599
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20493993
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 9310356
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20226525
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 3894223
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 9990352
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 19838996
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 13722608
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20486496
2026-03-29 20:27:45 [motorway.uk] INFO: Found listing with ID: 20043212
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720043212%27 HTTP/1.1" 200 None
2026-03-29 20:27:45 [motorway.uk] INFO: Scrape type for 20043212: 1
2026-03-29 20:27:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0674/20500674/exterior_rear_driver-1774784083945.jpg> (referer: None)
2026-03-29 20:27:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0674/20500674/exterior_rear_passenger-1774782211280.jpg> (referer: None)
2026-03-29 20:27:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_passenger-1774784097670.jpg> (referer: None)
2026-03-29 20:27:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0674/20500674/interior_rear_seats-1774783059646.jpg> (referer: None)
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f18450>
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Fexterior_rear_driver-1774784083945.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/exterior_rear_driver-1774784083945.jpg saved to cache
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec1d3d0>
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0674%252F20500674%252Fexterior_rear_passenger-1774782211280.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0674/20500674/exterior_rear_passenger-1774782211280.jpg saved to cache
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbaa310>
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Fexterior_front_passenger-1774784097670.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_passenger-1774784097670.jpg saved to cache
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9f710>
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0674%252F20500674%252Finterior_rear_seats-1774783059646.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0674/20500674/interior_rear_seats-1774783059646.jpg saved to cache
2026-03-29 20:27:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0674/20500674/interior_front_seats-1774783133023.jpg> (referer: None)
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d73b4d0>
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0674%252F20500674%252Finterior_front_seats-1774783133023.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0674/20500674/interior_front_seats-1774783133023.jpg saved to cache
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:27:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10536049.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c15fe650-af0b-53b8-a523-2ddc46a3a2e9 with identifier: 10536049
2026-03-29 20:27:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9 with scrape type 1
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_front_driver-1774697608557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_driver-1774697608557.jpg not downloaded yet
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_rear_driver-1774697519517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_driver-1774697519517.jpg not downloaded yet
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_front_passenger-1774697977776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_passenger-1774697977776.jpg not downloaded yet
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_rear_passenger-1774697772238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_passenger-1774697772238.jpg not downloaded yet
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Finterior_front_seats-1774698560026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/interior_front_seats-1774698560026.jpg not downloaded yet
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Finterior_rear_seats-1774698589764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/interior_rear_seats-1774698589764.jpg not downloaded yet
2026-03-29 20:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6049%252F10536049%252F10536049-interior_dashboard-modified-1774701836838.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:27:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6049/10536049/10536049-interior_dashboard-modified-1774701836838.jpeg not downloaded yet
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Finterior_boot-1774698609284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/interior_boot-1774698609284.jpg not downloaded yet
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6049%252F10536049%252Fdocs_service_history-1774698970309.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58eea02ccb47521fd63b03f7c3e09fea%27 HTTP/1.1" 200 None
2026-03-29 20:27:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6049/10536049/docs_service_history-1774698970309.jpg?ixlib=js-3.8.0&auto=format&s=58eea02ccb47521fd63b03f7c3e09fea not downloaded yet
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Fdamage_scratches-1774698180411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/damage_scratches-1774698180411.jpg not downloaded yet
2026-03-29 20:27:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.852(s), this was the 1st time calling it.
2026-03-29 20:27:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.95113545905444 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:27:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20426141.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289db541-a926-5885-b9ed-5d96c5c47dd1 with identifier: 20426141
2026-03-29 20:27:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289db541-a926-5885-b9ed-5d96c5c47dd1 with scrape type 1
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_front_driver-1774694930261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_driver-1774694930261.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_rear_driver-1774694876007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_driver-1774694876007.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_front_passenger-1774694903815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_passenger-1774694903815.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_rear_passenger-1774694888523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_passenger-1774694888523.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F20426141%252Finterior_front_seats-1774695466007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/20426141/interior_front_seats-1774695466007.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F20426141%252Finterior_rear_seats-1774695515339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/20426141/interior_rear_seats-1774695515339.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Finterior_dashboard-1774695297356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/interior_dashboard-1774695297356.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Finstrument_cluster-1774695359483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/instrument_cluster-1774695359483.jpg not downloaded yet
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F20426141%252Finterior_boot-1774695328356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/20426141/interior_boot-1774695328356.jpg not downloaded yet
2026-03-29 20:27:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3064694.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6141%252F20426141%252Fdamage_scratches-1774706033005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6141/20426141/damage_scratches-1774706033005.jpg not downloaded yet
2026-03-29 20:27:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:27:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6049/10536049/damage_scratches-1774698180411.jpg> (referer: None)
2026-03-29 20:27:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 with identifier: 3064694
2026-03-29 20:27:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 with scrape type 1
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_front_driver-1774535707257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_driver-1774535707257.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_rear_driver-1774535691889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_driver-1774535691889.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_front_passenger-1774535741369.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_passenger-1774535741369.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_rear_passenger-1774535794508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_passenger-1774535794508.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4694%252F3064694%252Finterior_front_seats-1774537247103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4694/3064694/interior_front_seats-1774537247103.jpg not downloaded yet
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01cc10>
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Fdamage_scratches-1774698180411.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/damage_scratches-1774698180411.jpg saved to cache
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4694%252F3064694%252Finterior_rear_seats-1774537303433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4694/3064694/interior_rear_seats-1774537303433.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Finterior_dashboard-1774537348326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/interior_dashboard-1774537348326.jpg not downloaded yet
2026-03-29 20:27:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6141/20426141/damage_scratches-1774706033005.jpg> (referer: None)
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4694%252F3064694%252Finstrument_cluster-1774613316715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4694/3064694/instrument_cluster-1774613316715.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4694%252F3064694%252Finterior_boot-1774537035813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4694/3064694/interior_boot-1774537035813.jpg not downloaded yet
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4694%252F3064694%252Fdocs_service_history-1774537600135.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9a2013f9cfc1190953c5ead0b50fc23%27 HTTP/1.1" 200 None
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4694/3064694/docs_service_history-1774537600135.jpg?ixlib=js-3.8.0&auto=format&s=d9a2013f9cfc1190953c5ead0b50fc23 not downloaded yet
2026-03-29 20:27:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6141/20426141/interior_boot-1774695328356.jpg> (referer: None)
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22df90>
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6141%252F20426141%252Fdamage_scratches-1774706033005.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6141/20426141/damage_scratches-1774706033005.jpg saved to cache
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7bc10>
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F20426141%252Finterior_boot-1774695328356.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/20426141/interior_boot-1774695328356.jpg saved to cache
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4694/3064694/docs_service_history-1774537600135.jpg?ixlib=js-3.8.0&auto=format&s=d9a2013f9cfc1190953c5ead0b50fc23> (referer: None)
2026-03-29 20:27:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4694/3064694/interior_dashboard-1774537348326.jpg> (referer: None)
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2724d0>
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4694%252F3064694%252Fdocs_service_history-1774537600135.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9a2013f9cfc1190953c5ead0b50fc23') HTTP/1.1" 204 0
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4694/3064694/docs_service_history-1774537600135.jpg?ixlib=js-3.8.0&auto=format&s=d9a2013f9cfc1190953c5ead0b50fc23 saved to cache
2026-03-29 20:27:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22e950>
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Finterior_dashboard-1774537348326.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/interior_dashboard-1774537348326.jpg saved to cache
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4694/3064694/instrument_cluster-1774613316715.jpg> (referer: None)
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1a1d0>
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4694%252F3064694%252Finstrument_cluster-1774613316715.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4694/3064694/instrument_cluster-1774613316715.jpg saved to cache
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4694/3064694/interior_boot-1774537035813.jpg> (referer: None)
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7a4d0>
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4694%252F3064694%252Finterior_boot-1774537035813.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4694/3064694/interior_boot-1774537035813.jpg saved to cache
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4694/3064694/interior_front_seats-1774537247103.jpg> (referer: None)
2026-03-29 20:27:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4694/3064694/interior_rear_seats-1774537303433.jpg> (referer: None)
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22c190>
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4694%252F3064694%252Finterior_front_seats-1774537247103.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4694/3064694/interior_front_seats-1774537247103.jpg saved to cache
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed78710>
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4694%252F3064694%252Finterior_rear_seats-1774537303433.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4694/3064694/interior_rear_seats-1774537303433.jpg saved to cache
2026-03-29 20:27:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_passenger-1774535794508.jpg> (referer: None)
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00f490>
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_rear_passenger-1774535794508.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_passenger-1774535794508.jpg saved to cache
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_passenger-1774535741369.jpg> (referer: None)
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea56550>
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_front_passenger-1774535741369.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_passenger-1774535741369.jpg saved to cache
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_driver-1774535691889.jpg> (referer: None)
2026-03-29 20:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_driver-1774535707257.jpg> (referer: None)
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2894d0>
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_rear_driver-1774535691889.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_driver-1774535691889.jpg saved to cache
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca251d0>
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4694%252F3064694%252Fexterior_front_driver-1774535707257.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_driver-1774535707257.jpg saved to cache
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34
2026-03-29 20:27:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8d552c3-2d30-5dcb-8146-ab8dc0a62d34, skipping ID generation
2026-03-29 20:27:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 with scrape type 1
2026-03-29 20:27:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 sending to next pipeline
2026-03-29 20:27:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e8d552c3-2d30-5dcb-8146-ab8dc0a62d34, identifier: 3064694
2026-03-29 20:27:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 with identifier: 3064694
2026-03-29 20:27:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 with identifier: 3064694
2026-03-29 20:27:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e8d552c3-2d30-5dcb-8146-ab8dc0a62d34 with identifier: 3064694 to the API
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_driver-1774535707257.jpg>
{'auction_title': '',
'category': None,
'color': 'Bronze',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e8d552c3-2d30-5dcb-8146-ab8dc0a62d34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM15 UGU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3064694',
'listing': 'auction',
'location': 'Cambridgeshire Cambridge',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 50600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105803,
'Height': 2701,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_driver-1774535707257.jpg',
'Width': 3601},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1991313,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_driver-1774535691889.jpg',
'Width': 3474},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870695,
'Height': 2525,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_front_passenger-1774535741369.jpg',
'Width': 3367},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1617648,
'Height': 2274,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4694/3064694/exterior_rear_passenger-1774535794508.jpg',
'Width': 3032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3550200,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4694/3064694/interior_front_seats-1774537247103.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3929458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4694/3064694/interior_rear_seats-1774537303433.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2584893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4694/3064694/interior_dashboard-1774537348326.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752791,
'Height': 2343,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4694/3064694/instrument_cluster-1774613316715.jpg',
'Width': 3124},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4420011,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4694/3064694/interior_boot-1774537035813.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d552c3-2d30-5dcb-8146-ab8dc0a62d34/e8d552c3-2d30-5dcb-8146-ab8dc0a62d34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470033,
'Height': 1171,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4694/3064694/docs_service_history-1774537600135.jpg?ixlib=js-3.8.0&auto=format&s=d9a2013f9cfc1190953c5ead0b50fc23',
'Width': 3457}],
'price': 6049,
'price_includes_vat': False,
'registration_date': '2015-05-29',
'seats_number': None,
'seller_name': None,
'title': 'Alfa Romeo Giulietta EX-IVE M-AIR TB S-A',
'transmission': 'automatic',
'trim': 'EX-IVE M-AIR TB S-A',
'vin': 'ZAR94000007378170',
'year': 2015}
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273064694%27 HTTP/1.1" 200 None
2026-03-29 20:27:53 [motorway.uk] INFO: Saving data for 3064694: {'created_time': 1774816073.695505, 'last_price_update_time': 1774816073.695515, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3064694') HTTP/1.1" 204 0
2026-03-29 20:27:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/20426141/interior_dashboard-1774695297356.jpg> (referer: None)
2026-03-29 20:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/20426141/instrument_cluster-1774695359483.jpg> (referer: None)
2026-03-29 20:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00cb10>
2026-03-29 20:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Finterior_dashboard-1774695297356.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/interior_dashboard-1774695297356.jpg saved to cache
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2a7e10>
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Finstrument_cluster-1774695359483.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/instrument_cluster-1774695359483.jpg saved to cache
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6141/20426141/interior_rear_seats-1774695515339.jpg> (referer: None)
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07910>
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F20426141%252Finterior_rear_seats-1774695515339.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/20426141/interior_rear_seats-1774695515339.jpg saved to cache
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6141/20426141/interior_front_seats-1774695466007.jpg> (referer: None)
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00ead0>
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6141%252F20426141%252Finterior_front_seats-1774695466007.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6141/20426141/interior_front_seats-1774695466007.jpg saved to cache
2026-03-29 20:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_passenger-1774694888523.jpg> (referer: None)
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf05c10>
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_rear_passenger-1774694888523.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_passenger-1774694888523.jpg saved to cache
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_passenger-1774694903815.jpg> (referer: None)
2026-03-29 20:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_driver-1774694876007.jpg> (referer: None)
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ed290>
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_front_passenger-1774694903815.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_passenger-1774694903815.jpg saved to cache
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00f0d0>
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_rear_driver-1774694876007.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_driver-1774694876007.jpg saved to cache
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6049/10536049/docs_service_history-1774698970309.jpg?ixlib=js-3.8.0&auto=format&s=58eea02ccb47521fd63b03f7c3e09fea> (referer: None)
2026-03-29 20:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_driver-1774694930261.jpg> (referer: None)
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf6e10>
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6049%252F10536049%252Fdocs_service_history-1774698970309.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58eea02ccb47521fd63b03f7c3e09fea') HTTP/1.1" 204 0
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6049/10536049/docs_service_history-1774698970309.jpg?ixlib=js-3.8.0&auto=format&s=58eea02ccb47521fd63b03f7c3e09fea saved to cache
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed9ae10>
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6141%252F20426141%252Fexterior_front_driver-1774694930261.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_driver-1774694930261.jpg saved to cache
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 289db541-a926-5885-b9ed-5d96c5c47dd1
2026-03-29 20:27:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 289db541-a926-5885-b9ed-5d96c5c47dd1, skipping ID generation
2026-03-29 20:27:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289db541-a926-5885-b9ed-5d96c5c47dd1 with scrape type 1
2026-03-29 20:27:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 289db541-a926-5885-b9ed-5d96c5c47dd1 sending to next pipeline
2026-03-29 20:27:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 289db541-a926-5885-b9ed-5d96c5c47dd1, identifier: 20426141
2026-03-29 20:27:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 289db541-a926-5885-b9ed-5d96c5c47dd1 with identifier: 20426141
2026-03-29 20:27:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 289db541-a926-5885-b9ed-5d96c5c47dd1 with identifier: 20426141
2026-03-29 20:27:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 289db541-a926-5885-b9ed-5d96c5c47dd1 with identifier: 20426141 to the API
2026-03-29 20:27:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_driver-1774694930261.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '289db541-a926-5885-b9ed-5d96c5c47dd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KT15 HBP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20426141',
'listing': 'auction',
'location': 'Merseyside Saint Helens',
'make': 'Peugeot',
'model': '208',
'odometer': 54000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1574840,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_driver-1774694930261.jpg',
'Width': 3562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1450869,
'Height': 2534,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_driver-1774694876007.jpg',
'Width': 3379},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484071,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_front_passenger-1774694903815.jpg',
'Width': 3267},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024275,
'Height': 3023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/20426141/exterior_rear_passenger-1774694888523.jpg',
'Width': 4030},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4757043,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6141/20426141/interior_front_seats-1774695466007.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3839171,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6141/20426141/interior_rear_seats-1774695515339.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1768425,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/20426141/interior_dashboard-1774695297356.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1851641,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6141/20426141/instrument_cluster-1774695359483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2537767,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6141/20426141/interior_boot-1774695328356.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289db541-a926-5885-b9ed-5d96c5c47dd1/289db541-a926-5885-b9ed-5d96c5c47dd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158414,
'Height': 684,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6141/20426141/damage_scratches-1774706033005.jpg',
'Width': 912}],
'price': 4143,
'price_includes_vat': False,
'registration_date': '2015-05-27',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 208 GT Line Pure Tech S/S Auto',
'transmission': 'automatic',
'trim': 'GT Line Pure Tech S/S Auto',
'vin': 'VF3CCHNZTFT062275',
'year': 2015}
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426141%27 HTTP/1.1" 200 None
2026-03-29 20:27:56 [motorway.uk] INFO: Saving data for 20426141: {'created_time': 1774816076.109325, 'last_price_update_time': 1774816076.109335, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20426141') HTTP/1.1" 204 0
2026-03-29 20:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6049/10536049/10536049-interior_dashboard-modified-1774701836838.jpeg> (referer: None)
2026-03-29 20:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6049/10536049/interior_boot-1774698609284.jpg> (referer: None)
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00db90>
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6049%252F10536049%252F10536049-interior_dashboard-modified-1774701836838.jpeg') HTTP/1.1" 204 0
2026-03-29 20:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6049/10536049/10536049-interior_dashboard-modified-1774701836838.jpeg saved to cache
2026-03-29 20:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00e2d0>
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Finterior_boot-1774698609284.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/interior_boot-1774698609284.jpg saved to cache
2026-03-29 20:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6049/10536049/interior_rear_seats-1774698589764.jpg> (referer: None)
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec82550>
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Finterior_rear_seats-1774698589764.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/interior_rear_seats-1774698589764.jpg saved to cache
2026-03-29 20:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6049/10536049/interior_front_seats-1774698560026.jpg> (referer: None)
2026-03-29 20:27:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_passenger-1774697772238.jpg> (referer: None)
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:27:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22f390>
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6049%252F10536049%252Finterior_front_seats-1774698560026.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6049/10536049/interior_front_seats-1774698560026.jpg saved to cache
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec82a90>
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_rear_passenger-1774697772238.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_passenger-1774697772238.jpg saved to cache
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_passenger-1774697977776.jpg> (referer: None)
2026-03-29 20:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_driver-1774697519517.jpg> (referer: None)
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02ea90>
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_front_passenger-1774697977776.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_passenger-1774697977776.jpg saved to cache
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d026b90>
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_rear_driver-1774697519517.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_driver-1774697519517.jpg saved to cache
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_driver-1774697608557.jpg> (referer: None)
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec75250>
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:27:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6049%252F10536049%252Fexterior_front_driver-1774697608557.jpg') HTTP/1.1" 204 0
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_driver-1774697608557.jpg saved to cache
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9
2026-03-29 20:27:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c15fe650-af0b-53b8-a523-2ddc46a3a2e9, skipping ID generation
2026-03-29 20:27:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9 with scrape type 1
2026-03-29 20:27:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c15fe650-af0b-53b8-a523-2ddc46a3a2e9 sending to next pipeline
2026-03-29 20:27:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c15fe650-af0b-53b8-a523-2ddc46a3a2e9, identifier: 10536049
2026-03-29 20:27:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c15fe650-af0b-53b8-a523-2ddc46a3a2e9 with identifier: 10536049
2026-03-29 20:27:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c15fe650-af0b-53b8-a523-2ddc46a3a2e9 with identifier: 10536049
2026-03-29 20:27:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c15fe650-af0b-53b8-a523-2ddc46a3a2e9 with identifier: 10536049 to the API
2026-03-29 20:27:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:27:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:27:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_driver-1774697608557.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c15fe650-af0b-53b8-a523-2ddc46a3a2e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'H11 KCS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10536049',
'listing': 'auction',
'location': 'Warrington Warrington',
'make': 'MINI',
'model': 'Clubman',
'odometer': 39000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2128693,
'Height': 2998,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_driver-1774697608557.jpg',
'Width': 3997},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870895,
'Height': 2961,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_driver-1774697519517.jpg',
'Width': 3948},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1837914,
'Height': 2952,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_front_passenger-1774697977776.jpg',
'Width': 3936},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2049562,
'Height': 2939,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6049/10536049/exterior_rear_passenger-1774697772238.jpg',
'Width': 3918},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3399171,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6049/10536049/interior_front_seats-1774698560026.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3856490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6049/10536049/interior_rear_seats-1774698589764.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2278416,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6049/10536049/10536049-interior_dashboard-modified-1774701836838.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503876,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6049/10536049/interior_boot-1774698609284.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330951,
'Height': 2926,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6049/10536049/docs_service_history-1774698970309.jpg?ixlib=js-3.8.0&auto=format&s=58eea02ccb47521fd63b03f7c3e09fea',
'Width': 2068},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15fe650-af0b-53b8-a523-2ddc46a3a2e9/c15fe650-af0b-53b8-a523-2ddc46a3a2e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3462895,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6049/10536049/damage_scratches-1774698180411.jpg',
'Width': 4032}],
'price': 11013,
'price_includes_vat': False,
'registration_date': '2016-11-21',
'seats_number': None,
'seller_name': None,
'title': 'MINI Clubman Cooper S Auto',
'transmission': 'automatic',
'trim': 'Cooper S Auto',
'vin': 'WMWLN720502F25192',
'year': 2016}
2026-03-29 20:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710536049%27 HTTP/1.1" 200 None
2026-03-29 20:27:58 [motorway.uk] INFO: Saving data for 10536049: {'created_time': 1774816078.437075, 'last_price_update_time': 1774816078.437086, 'auction_closing_time': 1774884600.0}
2026-03-29 20:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10536049') HTTP/1.1" 204 0
2026-03-29 20:28:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20178701.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:28:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:28:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e2d2839-e02e-500f-a929-3a0dd62ec36c with identifier: 20178701
2026-03-29 20:28:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c with scrape type 1
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_front_driver-1774687079366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_driver-1774687079366.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_rear_driver-1774687094191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_driver-1774687094191.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_front_passenger-1774687137157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_passenger-1774687137157.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_rear_passenger-1774687112184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_passenger-1774687112184.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8701%252F20178701%252Finterior_front_seats-1774688274236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8701/20178701/interior_front_seats-1774688274236.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8701%252F20178701%252Finterior_rear_seats-1774688152059.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8701/20178701/interior_rear_seats-1774688152059.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Finterior_dashboard-1774688317780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/interior_dashboard-1774688317780.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Finstrument_cluster-1774688253250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/instrument_cluster-1774688253250.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8701%252F20178701%252Finterior_boot-1774688236901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8701/20178701/interior_boot-1774688236901.jpg not downloaded yet
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8701%252F20178701%252Fdocs_service_history-1774688600034.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5600213350d7b63d589283c4aa686f7e%27 HTTP/1.1" 200 None
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8701/20178701/docs_service_history-1774688600034.jpg?ixlib=js-3.8.0&auto=format&s=5600213350d7b63d589283c4aa686f7e not downloaded yet
2026-03-29 20:28:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_driver-1774784071103.jpg> (referer: None)
2026-03-29 20:28:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7caf50>
2026-03-29 20:28:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0674%252F20500674%252Fexterior_front_driver-1774784071103.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_driver-1774784071103.jpg saved to cache
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1cc720d-8eab-54bc-ba82-044f2f5dc847
2026-03-29 20:28:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1cc720d-8eab-54bc-ba82-044f2f5dc847, skipping ID generation
2026-03-29 20:28:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cc720d-8eab-54bc-ba82-044f2f5dc847 with scrape type 1
2026-03-29 20:28:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1cc720d-8eab-54bc-ba82-044f2f5dc847 sending to next pipeline
2026-03-29 20:28:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a1cc720d-8eab-54bc-ba82-044f2f5dc847, identifier: 20500674
2026-03-29 20:28:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a1cc720d-8eab-54bc-ba82-044f2f5dc847 with identifier: 20500674
2026-03-29 20:28:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a1cc720d-8eab-54bc-ba82-044f2f5dc847 with identifier: 20500674
2026-03-29 20:28:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a1cc720d-8eab-54bc-ba82-044f2f5dc847 with identifier: 20500674 to the API
2026-03-29 20:28:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_driver-1774784071103.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a1cc720d-8eab-54bc-ba82-044f2f5dc847',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BP16 OSJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20500674',
'listing': 'auction',
'location': 'West Midlands Rowley Regis',
'make': 'Kia',
'model': 'Sportage',
'odometer': 69983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1681371,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_driver-1774784071103.jpg',
'Width': 3195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1082683,
'Height': 2021,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0674/20500674/exterior_rear_driver-1774784083945.jpg',
'Width': 2695},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1409459,
'Height': 2285,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0674/20500674/exterior_front_passenger-1774784097670.jpg',
'Width': 3047},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1135364,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0674/20500674/exterior_rear_passenger-1774782211280.jpg',
'Width': 3131},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5340950,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0674/20500674/interior_front_seats-1774783133023.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5087954,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0674/20500674/interior_rear_seats-1774783059646.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2396196,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0674/20500674/interior_dashboard-1774784056003.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4194550,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0674/20500674/interior_boot-1774783094699.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304575,
'Height': 1784,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783554817.jpg?ixlib=js-3.8.0&auto=format&s=3ed71f8bea6467a335c72c3fc4058930',
'Width': 3084},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cc720d-8eab-54bc-ba82-044f2f5dc847/a1cc720d-8eab-54bc-ba82-044f2f5dc847_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1756312,
'Height': 1764,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0674/20500674/docs_service_history-1774783555564.jpg?ixlib=js-3.8.0&auto=format&s=61c371e694c2c4fa9c4ea8fb95c07fc9',
'Width': 2564}],
'price': 7450,
'price_includes_vat': False,
'registration_date': '2016-06-07',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 3 ISG CRDI',
'transmission': 'manual',
'trim': '3 ISG CRDI',
'vin': 'U5YPH815LGL019061',
'year': 2016}
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500674%27 HTTP/1.1" 200 None
2026-03-29 20:28:05 [motorway.uk] INFO: Saving data for 20500674: {'created_time': 1774816085.26219, 'last_price_update_time': 1774816085.262201, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20500674') HTTP/1.1" 204 0
2026-03-29 20:28:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8701/20178701/docs_service_history-1774688600034.jpg?ixlib=js-3.8.0&auto=format&s=5600213350d7b63d589283c4aa686f7e> (referer: None)
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce2ba90>
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8701%252F20178701%252Fdocs_service_history-1774688600034.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5600213350d7b63d589283c4aa686f7e') HTTP/1.1" 204 0
2026-03-29 20:28:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8701/20178701/docs_service_history-1774688600034.jpg?ixlib=js-3.8.0&auto=format&s=5600213350d7b63d589283c4aa686f7e saved to cache
2026-03-29 20:28:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8701/20178701/interior_boot-1774688236901.jpg> (referer: None)
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf4d0>
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8701%252F20178701%252Finterior_boot-1774688236901.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8701/20178701/interior_boot-1774688236901.jpg saved to cache
2026-03-29 20:28:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8701/20178701/instrument_cluster-1774688253250.jpg> (referer: None)
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c31d0>
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:28:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Finstrument_cluster-1774688253250.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/instrument_cluster-1774688253250.jpg saved to cache
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:06 [scrapy.extensions.logstats] INFO: Crawled 278 pages (at 15 pages/min), scraped 227 items (at 10 items/min)
2026-03-29 20:28:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:28:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8701/20178701/interior_dashboard-1774688317780.jpg> (referer: None)
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a0210>
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Finterior_dashboard-1774688317780.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/interior_dashboard-1774688317780.jpg saved to cache
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8701/20178701/interior_rear_seats-1774688152059.jpg> (referer: None)
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093510>
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8701%252F20178701%252Finterior_rear_seats-1774688152059.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8701/20178701/interior_rear_seats-1774688152059.jpg saved to cache
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8701/20178701/interior_front_seats-1774688274236.jpg> (referer: None)
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce29fd0>
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8701%252F20178701%252Finterior_front_seats-1774688274236.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8701/20178701/interior_front_seats-1774688274236.jpg saved to cache
2026-03-29 20:28:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_passenger-1774687112184.jpg> (referer: None)
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a2050>
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_rear_passenger-1774687112184.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_passenger-1774687112184.jpg saved to cache
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_passenger-1774687137157.jpg> (referer: None)
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093950>
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_front_passenger-1774687137157.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_passenger-1774687137157.jpg saved to cache
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_driver-1774687094191.jpg> (referer: None)
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9b8110>
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_rear_driver-1774687094191.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_driver-1774687094191.jpg saved to cache
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_driver-1774687079366.jpg> (referer: None)
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad6e10>
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8701%252F20178701%252Fexterior_front_driver-1774687079366.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_driver-1774687079366.jpg saved to cache
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c
2026-03-29 20:28:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e2d2839-e02e-500f-a929-3a0dd62ec36c, skipping ID generation
2026-03-29 20:28:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c with scrape type 1
2026-03-29 20:28:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e2d2839-e02e-500f-a929-3a0dd62ec36c sending to next pipeline
2026-03-29 20:28:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1e2d2839-e02e-500f-a929-3a0dd62ec36c, identifier: 20178701
2026-03-29 20:28:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1e2d2839-e02e-500f-a929-3a0dd62ec36c with identifier: 20178701
2026-03-29 20:28:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1e2d2839-e02e-500f-a929-3a0dd62ec36c with identifier: 20178701
2026-03-29 20:28:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1e2d2839-e02e-500f-a929-3a0dd62ec36c with identifier: 20178701 to the API
2026-03-29 20:28:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_driver-1774687079366.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '1e2d2839-e02e-500f-a929-3a0dd62ec36c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YJ22 SJO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20178701',
'listing': 'auction',
'location': 'Stoke-on-Trent Stoke-on-Trent',
'make': 'BMW',
'model': '3 Series',
'odometer': 36405,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2076164,
'Height': 2860,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_driver-1774687079366.jpg',
'Width': 3813},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1741136,
'Height': 2650,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_driver-1774687094191.jpg',
'Width': 3533},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1644718,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_front_passenger-1774687137157.jpg',
'Width': 3506},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1460320,
'Height': 2649,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8701/20178701/exterior_rear_passenger-1774687112184.jpg',
'Width': 3532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3484344,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8701/20178701/interior_front_seats-1774688274236.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3185890,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8701/20178701/interior_rear_seats-1774688152059.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3466505,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8701/20178701/interior_dashboard-1774688317780.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1311536,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8701/20178701/instrument_cluster-1774688253250.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3504893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8701/20178701/interior_boot-1774688236901.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e2d2839-e02e-500f-a929-3a0dd62ec36c/1e2d2839-e02e-500f-a929-3a0dd62ec36c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358933,
'Height': 772,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8701/20178701/docs_service_history-1774688600034.jpg?ixlib=js-3.8.0&auto=format&s=5600213350d7b63d589283c4aa686f7e',
'Width': 2237}],
'price': 21623,
'price_includes_vat': False,
'registration_date': '2022-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 330E xDrive M Sport Auto',
'transmission': 'automatic',
'trim': '330E xDrive M Sport Auto',
'vin': 'WBA5P920X0FN16248',
'year': 2022}
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720178701%27 HTTP/1.1" 200 None
2026-03-29 20:28:08 [motorway.uk] INFO: Saving data for 20178701: {'created_time': 1774816088.19693, 'last_price_update_time': 1774816088.196942, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20178701') HTTP/1.1" 204 0
2026-03-29 20:28:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_driver-1774710137742.jpg> (referer: None)
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1955d0>
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_rear_driver-1774710137742.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_driver-1774710137742.jpg saved to cache
2026-03-29 20:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:28:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_driver-1774710240610.jpg> (referer: None)
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1f350>
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0281%252F20490281%252Fexterior_front_driver-1774710240610.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_driver-1774710240610.jpg saved to cache
2026-03-29 20:28:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928
2026-03-29 20:28:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 894c7bdc-7cfb-50cb-b27f-e4429c5cf928, skipping ID generation
2026-03-29 20:28:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 with scrape type 1
2026-03-29 20:28:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 sending to next pipeline
2026-03-29 20:28:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 894c7bdc-7cfb-50cb-b27f-e4429c5cf928, identifier: 20490281
2026-03-29 20:28:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 with identifier: 20490281
2026-03-29 20:28:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 with identifier: 20490281
2026-03-29 20:28:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 894c7bdc-7cfb-50cb-b27f-e4429c5cf928 with identifier: 20490281 to the API
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_driver-1774710240610.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '894c7bdc-7cfb-50cb-b27f-e4429c5cf928',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VU15 OSZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490281',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'Volvo',
'model': 'XC60',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1766594,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_driver-1774710240610.jpg',
'Width': 3527},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2073021,
'Height': 2896,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_driver-1774710137742.jpg',
'Width': 3861},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1968391,
'Height': 2864,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_front_passenger-1774710175033.jpg',
'Width': 3818},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1855873,
'Height': 2789,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0281/20490281/exterior_rear_passenger-1774710152331.jpg',
'Width': 3718},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3854289,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0281/20490281/interior_front_seats-1774710715000.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3105198,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0281/20490281/interior_rear_seats-1774710933460.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2360969,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0281/20490281/20490281-interior_dashboard-modified-1774711796743.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3617688,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0281/20490281/interior_boot-1774710806203.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2637074,
'Height': 1531,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711100173.jpg?ixlib=js-3.8.0&auto=format&s=280cac155f05bfe2e7f4460d444c4e5a',
'Width': 4076},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894c7bdc-7cfb-50cb-b27f-e4429c5cf928/894c7bdc-7cfb-50cb-b27f-e4429c5cf928_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2158503,
'Height': 1575,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0281/20490281/docs_service_history-1774711135052.jpg?ixlib=js-3.8.0&auto=format&s=b365ce11fc7009f1993fbaff76444d2a',
'Width': 3677}],
'price': 12465,
'price_includes_vat': False,
'registration_date': '2015-06-19',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 SE LUX NAV D4 AWD Auto',
'transmission': 'automatic',
'trim': 'SE LUX NAV D4 AWD Auto',
'vin': 'YV1DZ8156F2750522',
'year': 2015}
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490281%27 HTTP/1.1" 200 None
2026-03-29 20:28:09 [motorway.uk] INFO: Saving data for 20490281: {'created_time': 1774816089.306946, 'last_price_update_time': 1774816089.306959, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490281') HTTP/1.1" 204 0
2026-03-29 20:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774781823139.jpg> (referer: None)
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c2810>
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fdamage_missing_trims-1774781823139.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774781823139.jpg saved to cache
2026-03-29 20:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9298/20469298/interior_boot-1774779328194.jpg> (referer: None)
2026-03-29 20:28:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1e990>
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9298%252F20469298%252Finterior_boot-1774779328194.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9298/20469298/interior_boot-1774779328194.jpg saved to cache
2026-03-29 20:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/interior_dashboard-1774782838663.jpg> (referer: None)
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadd150>
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Finterior_dashboard-1774782838663.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/interior_dashboard-1774782838663.jpg saved to cache
2026-03-29 20:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2855/20052855/docs_service_history-1774698969617.jpg?ixlib=js-3.8.0&auto=format&s=c6ca1cd7da9912d7f9b2772fa2cbe4b9> (referer: None)
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9bb950>
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2855%252F20052855%252Fdocs_service_history-1774698969617.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6ca1cd7da9912d7f9b2772fa2cbe4b9') HTTP/1.1" 204 0
2026-03-29 20:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2855/20052855/docs_service_history-1774698969617.jpg?ixlib=js-3.8.0&auto=format&s=c6ca1cd7da9912d7f9b2772fa2cbe4b9 saved to cache
2026-03-29 20:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9298/20469298/interior_rear_seats-1774779243107.jpg> (referer: None)
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf410>
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9298%252F20469298%252Finterior_rear_seats-1774779243107.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9298/20469298/interior_rear_seats-1774779243107.jpg saved to cache
2026-03-29 20:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2855/20052855/interior_boot-1774698687936.jpg> (referer: None)
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d01ef90>
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2855%252F20052855%252Finterior_boot-1774698687936.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2855/20052855/interior_boot-1774698687936.jpg saved to cache
2026-03-29 20:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/interior_front_seats-1774781580135.jpg> (referer: None)
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d042a50>
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Finterior_front_seats-1774781580135.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/interior_front_seats-1774781580135.jpg saved to cache
2026-03-29 20:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2855/20052855/instrument_cluster-1774700431532.jpg> (referer: None)
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d197810>
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Finstrument_cluster-1774700431532.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/instrument_cluster-1774700431532.jpg saved to cache
2026-03-29 20:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_passenger-1774782801167.jpg> (referer: None)
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7c9e10>
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_rear_passenger-1774782801167.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_passenger-1774782801167.jpg saved to cache
2026-03-29 20:28:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2855/20052855/interior_dashboard-1774700361667.jpg> (referer: None)
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cad6650>
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Finterior_dashboard-1774700361667.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/interior_dashboard-1774700361667.jpg saved to cache
2026-03-29 20:28:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_passenger-1774781753428.jpg> (referer: None)
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7c94d0>
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_front_passenger-1774781753428.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_passenger-1774781753428.jpg saved to cache
2026-03-29 20:28:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2855/20052855/interior_rear_seats-1774698353371.jpg> (referer: None)
2026-03-29 20:28:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a2c50>
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2855%252F20052855%252Finterior_rear_seats-1774698353371.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2855/20052855/interior_rear_seats-1774698353371.jpg saved to cache
2026-03-29 20:28:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_driver-1774782684078.jpg> (referer: None)
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce20250>
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_rear_driver-1774782684078.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_driver-1774782684078.jpg saved to cache
2026-03-29 20:28:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2855/20052855/interior_front_seats-1774698163417.jpg> (referer: None)
2026-03-29 20:28:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a0350>
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2855%252F20052855%252Finterior_front_seats-1774698163417.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2855/20052855/interior_front_seats-1774698163417.jpg saved to cache
2026-03-29 20:28:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_driver-1774781647533.jpg> (referer: None)
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d040b10>
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9298%252F20469298%252Fexterior_front_driver-1774781647533.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_driver-1774781647533.jpg saved to cache
2026-03-29 20:28:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d
2026-03-29 20:28:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53b1c0af-d835-5ad3-bd5c-37a29c72b77d, skipping ID generation
2026-03-29 20:28:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d with scrape type 1
2026-03-29 20:28:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53b1c0af-d835-5ad3-bd5c-37a29c72b77d sending to next pipeline
2026-03-29 20:28:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 53b1c0af-d835-5ad3-bd5c-37a29c72b77d, identifier: 20469298
2026-03-29 20:28:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 53b1c0af-d835-5ad3-bd5c-37a29c72b77d with identifier: 20469298
2026-03-29 20:28:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 53b1c0af-d835-5ad3-bd5c-37a29c72b77d with identifier: 20469298
2026-03-29 20:28:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 53b1c0af-d835-5ad3-bd5c-37a29c72b77d with identifier: 20469298 to the API
2026-03-29 20:28:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_driver-1774781647533.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '53b1c0af-d835-5ad3-bd5c-37a29c72b77d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK69 ZRB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20469298',
'listing': 'auction',
'location': 'None None',
'make': 'Renault',
'model': 'Clio',
'odometer': 50206,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2238469,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_driver-1774781647533.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1939563,
'Height': 2351,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_driver-1774782684078.jpg',
'Width': 3135},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267628,
'Height': 2417,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/exterior_front_passenger-1774781753428.jpg',
'Width': 3223},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4040738,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/exterior_rear_passenger-1774782801167.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3589205,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/interior_front_seats-1774781580135.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4730111,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9298/20469298/interior_rear_seats-1774779243107.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3046895,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/interior_dashboard-1774782838663.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3898459,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9298/20469298/interior_boot-1774779328194.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330008,
'Height': 949,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774781823139.jpg',
'Width': 1265},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53b1c0af-d835-5ad3-bd5c-37a29c72b77d/53b1c0af-d835-5ad3-bd5c-37a29c72b77d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24082,
'Height': 275,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9298/20469298/damage_missing_trims-1774782767953.jpg',
'Width': 367}],
'price': 6833,
'price_includes_vat': False,
'registration_date': '2020-02-18',
'seats_number': None,
'seller_name': None,
'title': 'Renault Clio Iconic TCE',
'transmission': 'manual',
'trim': 'Iconic TCE',
'vin': 'VF1RJA00564440757',
'year': 2020}
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469298%27 HTTP/1.1" 200 None
2026-03-29 20:28:16 [motorway.uk] INFO: Saving data for 20469298: {'created_time': 1774816096.200602, 'last_price_update_time': 1774816096.200615, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20469298') HTTP/1.1" 204 0
2026-03-29 20:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_rear_passenger-1774699637258.jpg> (referer: None)
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce2a890>
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2855%252F20052855%252Fexterior_rear_passenger-1774699637258.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_rear_passenger-1774699637258.jpg saved to cache
2026-03-29 20:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_front_passenger-1774525216132.jpg> (referer: None)
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c2f10>
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2855%252F20052855%252Fexterior_front_passenger-1774525216132.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_front_passenger-1774525216132.jpg saved to cache
2026-03-29 20:28:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2855/20052855/exterior_rear_driver-1774700340495.jpg> (referer: None)
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cade290>
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Fexterior_rear_driver-1774700340495.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/exterior_rear_driver-1774700340495.jpg saved to cache
2026-03-29 20:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2855/20052855/exterior_front_driver-1774700330258.jpg> (referer: None)
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e092990>
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2855%252F20052855%252Fexterior_front_driver-1774700330258.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2855/20052855/exterior_front_driver-1774700330258.jpg saved to cache
2026-03-29 20:28:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa5df884-e2c5-5a72-a24f-6be62ed35889
2026-03-29 20:28:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa5df884-e2c5-5a72-a24f-6be62ed35889, skipping ID generation
2026-03-29 20:28:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa5df884-e2c5-5a72-a24f-6be62ed35889 with scrape type 1
2026-03-29 20:28:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa5df884-e2c5-5a72-a24f-6be62ed35889 sending to next pipeline
2026-03-29 20:28:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa5df884-e2c5-5a72-a24f-6be62ed35889, identifier: 20052855
2026-03-29 20:28:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa5df884-e2c5-5a72-a24f-6be62ed35889 with identifier: 20052855
2026-03-29 20:28:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa5df884-e2c5-5a72-a24f-6be62ed35889 with identifier: 20052855
2026-03-29 20:28:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa5df884-e2c5-5a72-a24f-6be62ed35889 with identifier: 20052855 to the API
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/2855/20052855/exterior_front_driver-1774700330258.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'aa5df884-e2c5-5a72-a24f-6be62ed35889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DU21 MPF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20052855',
'listing': 'auction',
'location': 'North Lanarkshire Airdrie',
'make': 'DS',
'model': 'Other DS',
'odometer': 30155,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503579,
'Height': 2930,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2855/20052855/exterior_front_driver-1774700330258.jpg',
'Width': 3907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1972462,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2855/20052855/exterior_rear_driver-1774700340495.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1717137,
'Height': 2625,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_front_passenger-1774525216132.jpg',
'Width': 3500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1834243,
'Height': 2881,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2855/20052855/exterior_rear_passenger-1774699637258.jpg',
'Width': 3841},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4025336,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2855/20052855/interior_front_seats-1774698163417.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3589505,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2855/20052855/interior_rear_seats-1774698353371.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2764444,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2855/20052855/interior_dashboard-1774700361667.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1412487,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2855/20052855/instrument_cluster-1774700431532.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3415772,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2855/20052855/interior_boot-1774698687936.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa5df884-e2c5-5a72-a24f-6be62ed35889/aa5df884-e2c5-5a72-a24f-6be62ed35889_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304346,
'Height': 1536,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2855/20052855/docs_service_history-1774698969617.jpg?ixlib=js-3.8.0&auto=format&s=c6ca1cd7da9912d7f9b2772fa2cbe4b9',
'Width': 2048}],
'price': 9265,
'price_includes_vat': False,
'registration_date': '2021-08-13',
'seats_number': None,
'seller_name': None,
'title': 'DS 3 Crossback Pfrmnc LNE + EV',
'transmission': 'automatic',
'trim': '3 Crossback Pfrmnc LNE + EV',
'vin': 'VR1UJZKXZMW048566',
'year': 2021}
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720052855%27 HTTP/1.1" 200 None
2026-03-29 20:28:17 [motorway.uk] INFO: Saving data for 20052855: {'created_time': 1774816097.92579, 'last_price_update_time': 1774816097.925806, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20052855') HTTP/1.1" 204 0
2026-03-29 20:28:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.108(s), this was the 2nd time calling it.
2026-03-29 20:28:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.073830662415029 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17316820.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:28:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:28:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e91580-ff21-5dfe-9043-46368e939fbf with identifier: 17316820
2026-03-29 20:28:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e91580-ff21-5dfe-9043-46368e939fbf with scrape type 1
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_front_driver-1774542793235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_driver-1774542793235.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_rear_driver-1774542706099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_driver-1774542706099.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_front_passenger-1774542764706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_passenger-1774542764706.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_rear_passenger-1774542713624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_passenger-1774542713624.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6820%252F17316820%252Finterior_front_seats-1774543325259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6820/17316820/interior_front_seats-1774543325259.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6820%252F17316820%252Finterior_rear_seats-1774543248388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6820/17316820/interior_rear_seats-1774543248388.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Finterior_dashboard-1774543353882.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/interior_dashboard-1774543353882.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Finstrument_cluster-1774712424437.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/instrument_cluster-1774712424437.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6820%252F17316820%252Finterior_boot-1774543294517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6820/17316820/interior_boot-1774543294517.jpg not downloaded yet
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6820%252F17316820%252Fdocs_service_history-1774543478832.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0065b04a45b10d623fd5dc33ff0a28ed%27 HTTP/1.1" 200 None
2026-03-29 20:28:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6820/17316820/docs_service_history-1774543478832.jpg?ixlib=js-3.8.0&auto=format&s=0065b04a45b10d623fd5dc33ff0a28ed not downloaded yet
2026-03-29 20:28:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20043212.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:28:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:28:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9923b5e-5d8d-5ab5-a80b-c803a2a8928a with identifier: 20043212
2026-03-29 20:28:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a with scrape type 1
2026-03-29 20:28:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_front_driver-1774623716115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_driver-1774623716115.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_rear_driver-1774623651547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_driver-1774623651547.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_front_passenger-1774623700969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_passenger-1774623700969.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_rear_passenger-1774623666006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_passenger-1774623666006.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3212%252F20043212%252Finterior_front_seats-1774624292046.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3212/20043212/interior_front_seats-1774624292046.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3212%252F20043212%252Finterior_rear_seats-1774624337724.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3212/20043212/interior_rear_seats-1774624337724.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Finterior_dashboard-1774624378309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/interior_dashboard-1774624378309.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3212%252F20043212%252Finterior_boot-1774624437665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3212/20043212/interior_boot-1774624437665.jpg not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3212%252F20043212%252Fdocs_service_history-1774715092282.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcbe5f480e31735246d07675e3bde350f%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715092282.jpg?ixlib=js-3.8.0&auto=format&s=cbe5f480e31735246d07675e3bde350f not downloaded yet
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3212%252F20043212%252Fdocs_service_history-1774715094121.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db0eaf124a6981ba05b8e9be6e06fe921%27 HTTP/1.1" 200 None
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715094121.jpg?ixlib=js-3.8.0&auto=format&s=b0eaf124a6981ba05b8e9be6e06fe921 not downloaded yet
2026-03-29 20:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6820/17316820/docs_service_history-1774543478832.jpg?ixlib=js-3.8.0&auto=format&s=0065b04a45b10d623fd5dc33ff0a28ed> (referer: None)
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1e090>
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6820%252F17316820%252Fdocs_service_history-1774543478832.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0065b04a45b10d623fd5dc33ff0a28ed') HTTP/1.1" 204 0
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6820/17316820/docs_service_history-1774543478832.jpg?ixlib=js-3.8.0&auto=format&s=0065b04a45b10d623fd5dc33ff0a28ed saved to cache
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715094121.jpg?ixlib=js-3.8.0&auto=format&s=b0eaf124a6981ba05b8e9be6e06fe921> (referer: None)
2026-03-29 20:28:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9e2d0>
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3212%252F20043212%252Fdocs_service_history-1774715094121.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db0eaf124a6981ba05b8e9be6e06fe921') HTTP/1.1" 204 0
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715094121.jpg?ixlib=js-3.8.0&auto=format&s=b0eaf124a6981ba05b8e9be6e06fe921 saved to cache
2026-03-29 20:28:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 20:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715092282.jpg?ixlib=js-3.8.0&auto=format&s=cbe5f480e31735246d07675e3bde350f> (referer: None)
2026-03-29 20:28:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d06b710>
2026-03-29 20:28:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3212%252F20043212%252Fdocs_service_history-1774715092282.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcbe5f480e31735246d07675e3bde350f') HTTP/1.1" 204 0
2026-03-29 20:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715092282.jpg?ixlib=js-3.8.0&auto=format&s=cbe5f480e31735246d07675e3bde350f saved to cache
2026-03-29 20:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3212/20043212/interior_boot-1774624437665.jpg> (referer: None)
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba9910>
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3212%252F20043212%252Finterior_boot-1774624437665.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3212/20043212/interior_boot-1774624437665.jpg saved to cache
2026-03-29 20:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3212/20043212/interior_dashboard-1774624378309.jpg> (referer: None)
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12c710>
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Finterior_dashboard-1774624378309.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/interior_dashboard-1774624378309.jpg saved to cache
2026-03-29 20:28:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3212/20043212/interior_rear_seats-1774624337724.jpg> (referer: None)
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf054d0>
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3212%252F20043212%252Finterior_rear_seats-1774624337724.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3212/20043212/interior_rear_seats-1774624337724.jpg saved to cache
2026-03-29 20:28:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3212/20043212/interior_front_seats-1774624292046.jpg> (referer: None)
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec07910>
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3212%252F20043212%252Finterior_front_seats-1774624292046.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3212/20043212/interior_front_seats-1774624292046.jpg saved to cache
2026-03-29 20:28:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_passenger-1774623666006.jpg> (referer: None)
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf05890>
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_rear_passenger-1774623666006.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_passenger-1774623666006.jpg saved to cache
2026-03-29 20:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_passenger-1774623700969.jpg> (referer: None)
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9ee90>
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_front_passenger-1774623700969.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_passenger-1774623700969.jpg saved to cache
2026-03-29 20:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_driver-1774623651547.jpg> (referer: None)
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d038290>
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_rear_driver-1774623651547.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_driver-1774623651547.jpg saved to cache
2026-03-29 20:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_driver-1774623716115.jpg> (referer: None)
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9fa50>
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3212%252F20043212%252Fexterior_front_driver-1774623716115.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_driver-1774623716115.jpg saved to cache
2026-03-29 20:28:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a
2026-03-29 20:28:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9923b5e-5d8d-5ab5-a80b-c803a2a8928a, skipping ID generation
2026-03-29 20:28:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a with scrape type 1
2026-03-29 20:28:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9923b5e-5d8d-5ab5-a80b-c803a2a8928a sending to next pipeline
2026-03-29 20:28:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b9923b5e-5d8d-5ab5-a80b-c803a2a8928a, identifier: 20043212
2026-03-29 20:28:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b9923b5e-5d8d-5ab5-a80b-c803a2a8928a with identifier: 20043212
2026-03-29 20:28:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b9923b5e-5d8d-5ab5-a80b-c803a2a8928a with identifier: 20043212
2026-03-29 20:28:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b9923b5e-5d8d-5ab5-a80b-c803a2a8928a with identifier: 20043212 to the API
2026-03-29 20:28:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_driver-1774623716115.jpg>
{'auction_title': '',
'category': None,
'color': 'Gold',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b9923b5e-5d8d-5ab5-a80b-c803a2a8928a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PK15 UKU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20043212',
'listing': 'auction',
'location': 'West Dunbartonshire Clydebank',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 70723,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1898910,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_driver-1774623716115.jpg',
'Width': 3582},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1344493,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_driver-1774623651547.jpg',
'Width': 2994},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1398756,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_front_passenger-1774623700969.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1313834,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3212/20043212/exterior_rear_passenger-1774623666006.jpg',
'Width': 3202},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150945,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3212/20043212/interior_front_seats-1774624292046.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3275628,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3212/20043212/interior_rear_seats-1774624337724.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2897658,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3212/20043212/interior_dashboard-1774624378309.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3769248,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3212/20043212/interior_boot-1774624437665.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5728188,
'Height': 3912,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715092282.jpg?ixlib=js-3.8.0&auto=format&s=cbe5f480e31735246d07675e3bde350f',
'Width': 2835},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9923b5e-5d8d-5ab5-a80b-c803a2a8928a/b9923b5e-5d8d-5ab5-a80b-c803a2a8928a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5026044,
'Height': 3778,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3212/20043212/docs_service_history-1774715094121.jpg?ixlib=js-3.8.0&auto=format&s=b0eaf124a6981ba05b8e9be6e06fe921',
'Width': 2668}],
'price': 14488,
'price_includes_vat': False,
'registration_date': '2015-04-18',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Rrover Sport Abio Dynam SDV6 A',
'transmission': 'automatic',
'trim': 'Rrover Sport Abio Dynam SDV6 A',
'vin': 'SALWA2KE6FA528729',
'year': 2015}
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720043212%27 HTTP/1.1" 200 None
2026-03-29 20:28:47 [motorway.uk] INFO: Saving data for 20043212: {'created_time': 1774816127.065613, 'last_price_update_time': 1774816127.065626, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20043212') HTTP/1.1" 204 0
2026-03-29 20:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6820/17316820/interior_boot-1774543294517.jpg> (referer: None)
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07e910>
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6820%252F17316820%252Finterior_boot-1774543294517.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6820/17316820/interior_boot-1774543294517.jpg saved to cache
2026-03-29 20:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6820/17316820/instrument_cluster-1774712424437.jpg> (referer: None)
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:28:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(EO\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x90\xc2\x00((\xc2\x00\x00\x00\x00'
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9cad0>
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Finstrument_cluster-1774712424437.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/instrument_cluster-1774712424437.jpg saved to cache
2026-03-29 20:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471278.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:28:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:28:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2939418-39e6-5958-a512-4182b3a4b09c with identifier: 20471278
2026-03-29 20:28:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2939418-39e6-5958-a512-4182b3a4b09c with scrape type 1
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_front_driver-1774614410952.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_driver-1774614410952.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_rear_driver-1774614423332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_driver-1774614423332.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_front_passenger-1774614451599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_passenger-1774614451599.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_rear_passenger-1774614436321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_passenger-1774614436321.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1278%252F20471278%252Finterior_front_seats-1774617004348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1278/20471278/interior_front_seats-1774617004348.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1278%252F20471278%252Finterior_rear_seats-1774617017147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1278/20471278/interior_rear_seats-1774617017147.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Finterior_dashboard-1774617037947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/interior_dashboard-1774617037947.jpg not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1278%252F20471278%252Finterior_boot-1774618440164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1278/20471278/interior_boot-1774618440164.jpg not downloaded yet
2026-03-29 20:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6820/17316820/interior_dashboard-1774543353882.jpg> (referer: None)
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1278%252F20471278%252Fdocs_service_history-1774617261056.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49114c8f86f7c445ac946c57c0dfee9c%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261056.jpg?ixlib=js-3.8.0&auto=format&s=49114c8f86f7c445ac946c57c0dfee9c not downloaded yet
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1278%252F20471278%252Fdocs_service_history-1774617261093.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D344fdb9bbe09cef6402ad92830f8e4bf%27 HTTP/1.1" 200 None
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261093.jpg?ixlib=js-3.8.0&auto=format&s=344fdb9bbe09cef6402ad92830f8e4bf not downloaded yet
2026-03-29 20:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6820/17316820/interior_rear_seats-1774543248388.jpg> (referer: None)
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00f390>
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Finterior_dashboard-1774543353882.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/interior_dashboard-1774543353882.jpg saved to cache
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c19690>
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6820%252F17316820%252Finterior_rear_seats-1774543248388.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6820/17316820/interior_rear_seats-1774543248388.jpg saved to cache
2026-03-29 20:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261093.jpg?ixlib=js-3.8.0&auto=format&s=344fdb9bbe09cef6402ad92830f8e4bf> (referer: None)
2026-03-29 20:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1278/20471278/interior_dashboard-1774617037947.jpg> (referer: None)
2026-03-29 20:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261056.jpg?ixlib=js-3.8.0&auto=format&s=49114c8f86f7c445ac946c57c0dfee9c> (referer: None)
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07c50>
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1278%252F20471278%252Fdocs_service_history-1774617261093.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D344fdb9bbe09cef6402ad92830f8e4bf') HTTP/1.1" 204 0
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261093.jpg?ixlib=js-3.8.0&auto=format&s=344fdb9bbe09cef6402ad92830f8e4bf saved to cache
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3b8d0>
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Finterior_dashboard-1774617037947.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/interior_dashboard-1774617037947.jpg saved to cache
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c256750>
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1278%252F20471278%252Fdocs_service_history-1774617261056.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49114c8f86f7c445ac946c57c0dfee9c') HTTP/1.1" 204 0
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261056.jpg?ixlib=js-3.8.0&auto=format&s=49114c8f86f7c445ac946c57c0dfee9c saved to cache
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1278/20471278/interior_rear_seats-1774617017147.jpg> (referer: None)
2026-03-29 20:28:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1278/20471278/interior_boot-1774618440164.jpg> (referer: None)
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22f090>
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1278%252F20471278%252Finterior_rear_seats-1774617017147.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1278/20471278/interior_rear_seats-1774617017147.jpg saved to cache
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec8a410>
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1278%252F20471278%252Finterior_boot-1774618440164.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1278/20471278/interior_boot-1774618440164.jpg saved to cache
2026-03-29 20:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1278/20471278/interior_front_seats-1774617004348.jpg> (referer: None)
2026-03-29 20:28:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22cc90>
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1278%252F20471278%252Finterior_front_seats-1774617004348.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1278/20471278/interior_front_seats-1774617004348.jpg saved to cache
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_passenger-1774614451599.jpg> (referer: None)
2026-03-29 20:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_passenger-1774614436321.jpg> (referer: None)
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec880d0>
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_front_passenger-1774614451599.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_passenger-1774614451599.jpg saved to cache
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22fa90>
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_rear_passenger-1774614436321.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_passenger-1774614436321.jpg saved to cache
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_driver-1774614410952.jpg> (referer: None)
2026-03-29 20:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_driver-1774614423332.jpg> (referer: None)
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec88790>
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_front_driver-1774614410952.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_driver-1774614410952.jpg saved to cache
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebef1d0>
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1278%252F20471278%252Fexterior_rear_driver-1774614423332.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_driver-1774614423332.jpg saved to cache
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2939418-39e6-5958-a512-4182b3a4b09c
2026-03-29 20:28:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2939418-39e6-5958-a512-4182b3a4b09c, skipping ID generation
2026-03-29 20:28:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2939418-39e6-5958-a512-4182b3a4b09c with scrape type 1
2026-03-29 20:28:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2939418-39e6-5958-a512-4182b3a4b09c sending to next pipeline
2026-03-29 20:28:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d2939418-39e6-5958-a512-4182b3a4b09c, identifier: 20471278
2026-03-29 20:28:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d2939418-39e6-5958-a512-4182b3a4b09c with identifier: 20471278
2026-03-29 20:28:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d2939418-39e6-5958-a512-4182b3a4b09c with identifier: 20471278
2026-03-29 20:28:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d2939418-39e6-5958-a512-4182b3a4b09c with identifier: 20471278 to the API
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_driver-1774614423332.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd2939418-39e6-5958-a512-4182b3a4b09c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RK11 WFO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471278',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 83500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 925463,
'Height': 2145,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_driver-1774614410952.jpg',
'Width': 2860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782133,
'Height': 1856,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_driver-1774614423332.jpg',
'Width': 2474},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 965906,
'Height': 2099,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_front_passenger-1774614451599.jpg',
'Width': 2799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1023417,
'Height': 2111,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1278/20471278/exterior_rear_passenger-1774614436321.jpg',
'Width': 2815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3694203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1278/20471278/interior_front_seats-1774617004348.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3424638,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1278/20471278/interior_rear_seats-1774617017147.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3934705,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1278/20471278/interior_dashboard-1774617037947.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3274136,
'Height': 2680,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1278/20471278/interior_boot-1774618440164.jpg',
'Width': 3573},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342810,
'Height': 2440,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261056.jpg?ixlib=js-3.8.0&auto=format&s=49114c8f86f7c445ac946c57c0dfee9c',
'Width': 1625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2939418-39e6-5958-a512-4182b3a4b09c/d2939418-39e6-5958-a512-4182b3a4b09c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2393836,
'Height': 2539,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1278/20471278/docs_service_history-1774617261093.jpg?ixlib=js-3.8.0&auto=format&s=344fdb9bbe09cef6402ad92830f8e4bf',
'Width': 1721}],
'price': 1914,
'price_includes_vat': False,
'registration_date': '2011-03-08',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo S 60',
'transmission': 'manual',
'trim': 'S 60',
'vin': 'WVWZZZ6RZBU014954',
'year': 2011}
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471278%27 HTTP/1.1" 200 None
2026-03-29 20:28:51 [motorway.uk] INFO: Saving data for 20471278: {'created_time': 1774816131.514089, 'last_price_update_time': 1774816131.5141, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471278') HTTP/1.1" 204 0
2026-03-29 20:28:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_passenger-1774542713624.jpg> (referer: None)
2026-03-29 20:28:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6820/17316820/interior_front_seats-1774543325259.jpg> (referer: None)
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d204b10>
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_rear_passenger-1774542713624.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_passenger-1774542713624.jpg saved to cache
2026-03-29 20:28:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:28:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:28:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:28:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d00ff90>
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6820%252F17316820%252Finterior_front_seats-1774543325259.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6820/17316820/interior_front_seats-1774543325259.jpg saved to cache
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_passenger-1774542764706.jpg> (referer: None)
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf047d0>
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_front_passenger-1774542764706.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_passenger-1774542764706.jpg saved to cache
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_driver-1774542793235.jpg> (referer: None)
2026-03-29 20:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_driver-1774542706099.jpg> (referer: None)
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7cb3d0>
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_front_driver-1774542793235.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_driver-1774542793235.jpg saved to cache
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7dc10>
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6820%252F17316820%252Fexterior_rear_driver-1774542706099.jpg') HTTP/1.1" 204 0
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_driver-1774542706099.jpg saved to cache
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64e91580-ff21-5dfe-9043-46368e939fbf
2026-03-29 20:28:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64e91580-ff21-5dfe-9043-46368e939fbf, skipping ID generation
2026-03-29 20:28:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e91580-ff21-5dfe-9043-46368e939fbf with scrape type 1
2026-03-29 20:28:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64e91580-ff21-5dfe-9043-46368e939fbf sending to next pipeline
2026-03-29 20:28:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 64e91580-ff21-5dfe-9043-46368e939fbf, identifier: 17316820
2026-03-29 20:28:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 64e91580-ff21-5dfe-9043-46368e939fbf with identifier: 17316820
2026-03-29 20:28:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 64e91580-ff21-5dfe-9043-46368e939fbf with identifier: 17316820
2026-03-29 20:28:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 64e91580-ff21-5dfe-9043-46368e939fbf with identifier: 17316820 to the API
2026-03-29 20:28:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:28:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:28:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_driver-1774542706099.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '64e91580-ff21-5dfe-9043-46368e939fbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC18 PYF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17316820',
'listing': 'auction',
'location': 'Greater Manchester Rochdale',
'make': 'Kia',
'model': 'Sportage',
'odometer': 73240,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1826265,
'Height': 3001,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_driver-1774542793235.jpg',
'Width': 4001},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1232119,
'Height': 2538,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_driver-1774542706099.jpg',
'Width': 3384},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1733091,
'Height': 2987,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_front_passenger-1774542764706.jpg',
'Width': 3983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1715582,
'Height': 2974,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6820/17316820/exterior_rear_passenger-1774542713624.jpg',
'Width': 3965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5502284,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6820/17316820/interior_front_seats-1774543325259.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4437358,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6820/17316820/interior_rear_seats-1774543248388.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4213062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6820/17316820/interior_dashboard-1774543353882.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2807313,
'Height': 2268,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6820/17316820/instrument_cluster-1774712424437.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3071562,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6820/17316820/interior_boot-1774543294517.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e91580-ff21-5dfe-9043-46368e939fbf/64e91580-ff21-5dfe-9043-46368e939fbf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 920449,
'Height': 2657,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6820/17316820/docs_service_history-1774543478832.jpg?ixlib=js-3.8.0&auto=format&s=0065b04a45b10d623fd5dc33ff0a28ed',
'Width': 3880}],
'price': 9038,
'price_includes_vat': False,
'registration_date': '2018-06-08',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 3 CRDI ISG S-A',
'transmission': 'automatic',
'trim': '3 CRDI ISG S-A',
'vin': 'U5YPH815VHL432779',
'year': 2018}
2026-03-29 20:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717316820%27 HTTP/1.1" 200 None
2026-03-29 20:28:53 [motorway.uk] INFO: Saving data for 17316820: {'created_time': 1774816133.294452, 'last_price_update_time': 1774816133.294465, 'auction_closing_time': 1774884600.0}
2026-03-29 20:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17316820') HTTP/1.1" 204 0
2026-03-29 20:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20405344.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:28:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:28:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ec0c90-b628-50a1-8914-550f44bb87cb with identifier: 20405344
2026-03-29 20:28:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ec0c90-b628-50a1-8914-550f44bb87cb with scrape type 1
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_front_driver-1774716869397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_driver-1774716869397.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_rear_driver-1774716873410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_driver-1774716873410.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_front_passenger-1774716903276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_passenger-1774716903276.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_rear_passenger-1774716883848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_passenger-1774716883848.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5344%252F20405344%252Finterior_front_seats-1774719009671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5344/20405344/interior_front_seats-1774719009671.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5344%252F20405344%252Finterior_rear_seats-1774719015661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5344/20405344/interior_rear_seats-1774719015661.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5344%252F20405344%252Finterior_dashboard-1774783163042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5344/20405344/interior_dashboard-1774783163042.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5344%252F20405344%252Finterior_boot-1774719122628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5344/20405344/interior_boot-1774719122628.jpg not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5344%252F20405344%252Fdocs_service_history-1774783638699.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0fd6eb78bb5aa8fe707f97b1da64d78%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783638699.jpg?ixlib=js-3.8.0&auto=format&s=f0fd6eb78bb5aa8fe707f97b1da64d78 not downloaded yet
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5344%252F20405344%252Fdocs_service_history-1774783730616.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ded15288e205c65ea834ebcb80ebc73ec%27 HTTP/1.1" 200 None
2026-03-29 20:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783730616.jpg?ixlib=js-3.8.0&auto=format&s=ed15288e205c65ea834ebcb80ebc73ec not downloaded yet
2026-03-29 20:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19772114.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:28:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:28:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f926dcc1-de11-5544-9fc1-34ef1dacc45a with identifier: 19772114
2026-03-29 20:28:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f926dcc1-de11-5544-9fc1-34ef1dacc45a with scrape type 1
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_front_driver-1771233355392.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_driver-1771233355392.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_rear_driver-1771233331276.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_driver-1771233331276.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_front_passenger-1771233368136.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_passenger-1771233368136.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_rear_passenger-1771233325584.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_passenger-1771233325584.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finterior_front_seats-1774695535362.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/interior_front_seats-1774695535362.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finterior_rear_seats-1771233490470.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/interior_rear_seats-1771233490470.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Finterior_dashboard-1771233526201.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/interior_dashboard-1771233526201.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finstrument_cluster-1771233469119.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/instrument_cluster-1771233469119.jpeg not downloaded yet
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finterior_boot-1771233520489.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/interior_boot-1771233520489.jpeg not downloaded yet
2026-03-29 20:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783730616.jpg?ixlib=js-3.8.0&auto=format&s=ed15288e205c65ea834ebcb80ebc73ec> (referer: None)
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2114%252F19772114%252F19772114-docs_service_history-modified-1774541996948.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd21cae9e0eaa3b23fafbaffb21891ac0%27 HTTP/1.1" 200 None
2026-03-29 20:28:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2114/19772114/19772114-docs_service_history-modified-1774541996948.jpeg?ixlib=js-3.8.0&auto=format&s=d21cae9e0eaa3b23fafbaffb21891ac0 not downloaded yet
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d025610>
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5344%252F20405344%252Fdocs_service_history-1774783730616.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ded15288e205c65ea834ebcb80ebc73ec') HTTP/1.1" 204 0
2026-03-29 20:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783730616.jpg?ixlib=js-3.8.0&auto=format&s=ed15288e205c65ea834ebcb80ebc73ec saved to cache
2026-03-29 20:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2114/19772114/interior_boot-1771233520489.jpeg> (referer: None)
2026-03-29 20:28:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:28:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:28:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009\xae\xc4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xcf\xd9\x009\xa4\xea\x00\x00\x00\x00'
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c407850>
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finterior_boot-1771233520489.jpeg') HTTP/1.1" 204 0
2026-03-29 20:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/interior_boot-1771233520489.jpeg saved to cache
2026-03-29 20:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2114/19772114/19772114-docs_service_history-modified-1774541996948.jpeg?ixlib=js-3.8.0&auto=format&s=d21cae9e0eaa3b23fafbaffb21891ac0> (referer: None)
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3bd50>
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2114%252F19772114%252F19772114-docs_service_history-modified-1774541996948.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd21cae9e0eaa3b23fafbaffb21891ac0') HTTP/1.1" 204 0
2026-03-29 20:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2114/19772114/19772114-docs_service_history-modified-1774541996948.jpeg?ixlib=js-3.8.0&auto=format&s=d21cae9e0eaa3b23fafbaffb21891ac0 saved to cache
2026-03-29 20:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2114/19772114/instrument_cluster-1771233469119.jpeg> (referer: None)
2026-03-29 20:28:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:28:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:28:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%*\x80\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd1\xff\x00% \xa6\x00\x00\x00\x00'
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c407b10>
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finstrument_cluster-1771233469119.jpeg') HTTP/1.1" 204 0
2026-03-29 20:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/instrument_cluster-1771233469119.jpeg saved to cache
2026-03-29 20:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2114/19772114/interior_dashboard-1771233526201.jpeg> (referer: None)
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3a6d0>
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Finterior_dashboard-1771233526201.jpeg') HTTP/1.1" 204 0
2026-03-29 20:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/interior_dashboard-1771233526201.jpeg saved to cache
2026-03-29 20:28:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2114/19772114/interior_rear_seats-1771233490470.jpeg> (referer: None)
2026-03-29 20:28:59 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:28:59 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:28:59 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.\xa5\xa6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xb5\x04\x00.\x9b\xcc\x00\x00\x00\x00'
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22dc10>
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finterior_rear_seats-1771233490470.jpeg') HTTP/1.1" 204 0
2026-03-29 20:28:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/interior_rear_seats-1771233490470.jpeg saved to cache
2026-03-29 20:28:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2114/19772114/interior_front_seats-1774695535362.jpeg> (referer: None)
2026-03-29 20:28:59 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:28:59 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:28:59 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005\xdf\xce\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02k\xae\x005\xd5\xf4\x00\x00\x00\x00'
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01c9d0>
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:28:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2114%252F19772114%252Finterior_front_seats-1774695535362.jpeg') HTTP/1.1" 204 0
2026-03-29 20:28:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2114/19772114/interior_front_seats-1774695535362.jpeg saved to cache
2026-03-29 20:28:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:28:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_passenger-1771233325584.jpeg> (referer: None)
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c257c90>
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_rear_passenger-1771233325584.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_passenger-1771233325584.jpeg saved to cache
2026-03-29 20:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:29:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.569(s), this was the 1st time calling it.
2026-03-29 20:29:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.495417800463563 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:29:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_passenger-1771233368136.jpeg> (referer: None)
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c497d0>
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_front_passenger-1771233368136.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_passenger-1771233368136.jpeg saved to cache
2026-03-29 20:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:29:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_driver-1771233331276.jpeg> (referer: None)
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22ee10>
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_rear_driver-1771233331276.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_driver-1771233331276.jpeg saved to cache
2026-03-29 20:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:29:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_driver-1771233355392.jpeg> (referer: None)
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d118850>
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2114%252F19772114%252Fexterior_front_driver-1771233355392.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_driver-1771233355392.jpeg saved to cache
2026-03-29 20:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f926dcc1-de11-5544-9fc1-34ef1dacc45a
2026-03-29 20:29:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f926dcc1-de11-5544-9fc1-34ef1dacc45a, skipping ID generation
2026-03-29 20:29:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f926dcc1-de11-5544-9fc1-34ef1dacc45a with scrape type 1
2026-03-29 20:29:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f926dcc1-de11-5544-9fc1-34ef1dacc45a sending to next pipeline
2026-03-29 20:29:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f926dcc1-de11-5544-9fc1-34ef1dacc45a, identifier: 19772114
2026-03-29 20:29:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f926dcc1-de11-5544-9fc1-34ef1dacc45a with identifier: 19772114
2026-03-29 20:29:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f926dcc1-de11-5544-9fc1-34ef1dacc45a with identifier: 19772114
2026-03-29 20:29:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f926dcc1-de11-5544-9fc1-34ef1dacc45a with identifier: 19772114 to the API
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_driver-1771233355392.jpeg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f926dcc1-de11-5544-9fc1-34ef1dacc45a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR66 BJU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19772114',
'listing': 'auction',
'location': 'Wiltshire Chippenham',
'make': 'Honda',
'model': 'Jazz',
'odometer': 66000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1558841,
'Height': 2723,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_driver-1771233355392.jpeg',
'Width': 3630},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1833557,
'Height': 2921,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_driver-1771233331276.jpeg',
'Width': 3895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1151413,
'Height': 2610,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_front_passenger-1771233368136.jpeg',
'Width': 3480},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1394231,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2114/19772114/exterior_rear_passenger-1771233325584.jpeg',
'Width': 3298},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3689340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2114/19772114/interior_front_seats-1774695535362.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3168938,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2114/19772114/interior_rear_seats-1771233490470.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1558597,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2114/19772114/interior_dashboard-1771233526201.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2620543,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2114/19772114/instrument_cluster-1771233469119.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3964573,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2114/19772114/interior_boot-1771233520489.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f926dcc1-de11-5544-9fc1-34ef1dacc45a/f926dcc1-de11-5544-9fc1-34ef1dacc45a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2004804,
'Height': 2647,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2114/19772114/19772114-docs_service_history-modified-1774541996948.jpeg?ixlib=js-3.8.0&auto=format&s=d21cae9e0eaa3b23fafbaffb21891ac0',
'Width': 3529}],
'price': 7106,
'price_includes_vat': False,
'registration_date': '2016-12-23',
'seats_number': None,
'seller_name': None,
'title': 'Honda Jazz SE I-VTEC CVT',
'transmission': 'automatic',
'trim': 'SE I-VTEC CVT',
'vin': 'JHMGK3850GX221666',
'year': 2016}
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719772114%27 HTTP/1.1" 200 None
2026-03-29 20:29:01 [motorway.uk] INFO: Saving data for 19772114: {'created_time': 1774816141.637374, 'last_price_update_time': 1774816141.637385, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19772114') HTTP/1.1" 204 0
2026-03-29 20:29:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783638699.jpg?ixlib=js-3.8.0&auto=format&s=f0fd6eb78bb5aa8fe707f97b1da64d78> (referer: None)
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d196090>
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5344%252F20405344%252Fdocs_service_history-1774783638699.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0fd6eb78bb5aa8fe707f97b1da64d78') HTTP/1.1" 204 0
2026-03-29 20:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783638699.jpg?ixlib=js-3.8.0&auto=format&s=f0fd6eb78bb5aa8fe707f97b1da64d78 saved to cache
2026-03-29 20:29:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5344/20405344/interior_boot-1774719122628.jpg> (referer: None)
2026-03-29 20:29:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07610>
2026-03-29 20:29:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5344%252F20405344%252Finterior_boot-1774719122628.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5344/20405344/interior_boot-1774719122628.jpg saved to cache
2026-03-29 20:29:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5344/20405344/interior_dashboard-1774783163042.jpg> (referer: None)
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d025cd0>
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5344%252F20405344%252Finterior_dashboard-1774783163042.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5344/20405344/interior_dashboard-1774783163042.jpg saved to cache
2026-03-29 20:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5344/20405344/interior_rear_seats-1774719015661.jpg> (referer: None)
2026-03-29 20:29:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea655d0>
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5344%252F20405344%252Finterior_rear_seats-1774719015661.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5344/20405344/interior_rear_seats-1774719015661.jpg saved to cache
2026-03-29 20:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5344/20405344/interior_front_seats-1774719009671.jpg> (referer: None)
2026-03-29 20:29:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea67510>
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5344%252F20405344%252Finterior_front_seats-1774719009671.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5344/20405344/interior_front_seats-1774719009671.jpg saved to cache
2026-03-29 20:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_passenger-1774716883848.jpg> (referer: None)
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b4610>
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_rear_passenger-1774716883848.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_passenger-1774716883848.jpg saved to cache
2026-03-29 20:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_passenger-1774716903276.jpg> (referer: None)
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b4910>
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_front_passenger-1774716903276.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_passenger-1774716903276.jpg saved to cache
2026-03-29 20:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_driver-1774716873410.jpg> (referer: None)
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7ac10>
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_rear_driver-1774716873410.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_driver-1774716873410.jpg saved to cache
2026-03-29 20:29:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_driver-1774716869397.jpg> (referer: None)
2026-03-29 20:29:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7bdd0>
2026-03-29 20:29:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5344%252F20405344%252Fexterior_front_driver-1774716869397.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_driver-1774716869397.jpg saved to cache
2026-03-29 20:29:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70ec0c90-b628-50a1-8914-550f44bb87cb
2026-03-29 20:29:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70ec0c90-b628-50a1-8914-550f44bb87cb, skipping ID generation
2026-03-29 20:29:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ec0c90-b628-50a1-8914-550f44bb87cb with scrape type 1
2026-03-29 20:29:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70ec0c90-b628-50a1-8914-550f44bb87cb sending to next pipeline
2026-03-29 20:29:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 70ec0c90-b628-50a1-8914-550f44bb87cb, identifier: 20405344
2026-03-29 20:29:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 70ec0c90-b628-50a1-8914-550f44bb87cb with identifier: 20405344
2026-03-29 20:29:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 70ec0c90-b628-50a1-8914-550f44bb87cb with identifier: 20405344
2026-03-29 20:29:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 70ec0c90-b628-50a1-8914-550f44bb87cb with identifier: 20405344 to the API
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_driver-1774716869397.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '70ec0c90-b628-50a1-8914-550f44bb87cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK65 BAO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20405344',
'listing': 'auction',
'location': 'Devon Exmouth',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 11000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1489895,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_driver-1774716869397.jpg',
'Width': 2983},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1805690,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_driver-1774716873410.jpg',
'Width': 3359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1945787,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_front_passenger-1774716903276.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1250278,
'Height': 2305,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5344/20405344/exterior_rear_passenger-1774716883848.jpg',
'Width': 3073},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3296617,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5344/20405344/interior_front_seats-1774719009671.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4124436,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5344/20405344/interior_rear_seats-1774719015661.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3220466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5344/20405344/interior_dashboard-1774783163042.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5119490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5344/20405344/interior_boot-1774719122628.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773504,
'Height': 2163,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783638699.jpg?ixlib=js-3.8.0&auto=format&s=f0fd6eb78bb5aa8fe707f97b1da64d78',
'Width': 3698},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70ec0c90-b628-50a1-8914-550f44bb87cb/70ec0c90-b628-50a1-8914-550f44bb87cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597798,
'Height': 1826,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5344/20405344/docs_service_history-1774783730616.jpg?ixlib=js-3.8.0&auto=format&s=ed15288e205c65ea834ebcb80ebc73ec',
'Width': 3530}],
'price': 6242,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seats_number': None,
'seller_name': None,
'title': 'Citroen Berlingo M-SPACE VTR e-HDi S-A',
'transmission': 'automatic',
'trim': 'M-SPACE VTR e-HDi S-A',
'vin': 'VF77J9HP8F647351',
'year': 2015}
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405344%27 HTTP/1.1" 200 None
2026-03-29 20:29:05 [motorway.uk] INFO: Saving data for 20405344: {'created_time': 1774816145.862412, 'last_price_update_time': 1774816145.862427, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20405344') HTTP/1.1" 204 0
2026-03-29 20:29:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:29:05 [scrapy.extensions.logstats] INFO: Crawled 283 pages (at 5 pages/min), scraped 236 items (at 9 items/min)
2026-03-29 20:29:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:29:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18264016.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d090ae62-467e-5a7e-b7f4-15bbea9800ec with identifier: 18264016
2026-03-29 20:29:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d090ae62-467e-5a7e-b7f4-15bbea9800ec with scrape type 1
2026-03-29 20:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_front_driver-default-1774706464663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_driver-default-1774706464663.jpg not downloaded yet
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_rear_driver-default-1774706463954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_driver-default-1774706463954.jpg not downloaded yet
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_front_passenger-default-1774706463956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_passenger-default-1774706463956.jpg not downloaded yet
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_rear_passenger-default-1774706463829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_passenger-default-1774706463829.jpg not downloaded yet
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4016%252F18264016%252F18264016-interior_front_seats-default-1774706472738.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4016/18264016/18264016-interior_front_seats-default-1774706472738.jpg not downloaded yet
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4016%252F18264016%252F18264016-interior_rear_seats-default-1774706471168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4016/18264016/18264016-interior_rear_seats-default-1774706471168.jpg not downloaded yet
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-interior_dashboard-default-1774706482676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-interior_dashboard-default-1774706482676.jpg not downloaded yet
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-instrument_cluster-default-1774706625609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-instrument_cluster-default-1774706625609.jpg not downloaded yet
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4016%252F18264016%252F18264016-interior_boot-default-1774706468152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4016/18264016/18264016-interior_boot-default-1774706468152.jpg not downloaded yet
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4016%252F18264016%252F18264016-docs_service_history-modified-1764601009811.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0222ec60c596c1e73fd956843d36b9c3%27 HTTP/1.1" 200 None
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4016/18264016/18264016-docs_service_history-modified-1764601009811.png?ixlib=js-3.8.0&auto=format&s=0222ec60c596c1e73fd956843d36b9c3 not downloaded yet
2026-03-29 20:29:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8854/16548854/interior_rear_seats-1774687751607.jpg> (referer: None)
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0b\xb8'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0f\xa0'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: BitsPerSample (258) - type: short (3) Tag Location: 46 - Data Location: 218 - value: b'\x00\x08\x00\x08\x00\x08'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 158 - value: b'HONOR\x00'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 70 - Data Location: 164 - value: b'ALI-NX1\x00'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 172 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 188 - value: b'ALI-N21 9.0.0.191(C431E5R3P1)\x00'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 224 - value: b'2026:03:27 17:22:41\x00'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xf4'
2026-03-29 20:29:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebee2d0>
2026-03-29 20:29:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8854%252F16548854%252Finterior_rear_seats-1774687751607.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8854/16548854/interior_rear_seats-1774687751607.jpg saved to cache
2026-03-29 20:29:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:29:17 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11297003) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/modified/4016/18264016/18264016-docs_service_history-modified-1764601009811.png?ixlib=js-3.8.0&auto=format&s=0222ec60c596c1e73fd956843d36b9c3>.
2026-03-29 20:29:18 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/modified/4016/18264016/18264016-docs_service_history-modified-1764601009811.png?ixlib=js-3.8.0&auto=format&s=0222ec60c596c1e73fd956843d36b9c3>.
2026-03-29 20:29:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4016/18264016/18264016-docs_service_history-modified-1764601009811.png?ixlib=js-3.8.0&auto=format&s=0222ec60c596c1e73fd956843d36b9c3> (referer: None)
2026-03-29 20:29:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:29:18 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 4096
2026-03-29 20:29:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976950>
2026-03-29 20:29:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_9.png HTTP/1.1" 201 0
2026-03-29 20:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4016%252F18264016%252F18264016-docs_service_history-modified-1764601009811.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0222ec60c596c1e73fd956843d36b9c3') HTTP/1.1" 204 0
2026-03-29 20:29:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4016/18264016/18264016-docs_service_history-modified-1764601009811.png?ixlib=js-3.8.0&auto=format&s=0222ec60c596c1e73fd956843d36b9c3 saved to cache
2026-03-29 20:29:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4016/18264016/18264016-interior_boot-default-1774706468152.jpg> (referer: None)
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d22cd10>
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4016%252F18264016%252F18264016-interior_boot-default-1774706468152.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4016/18264016/18264016-interior_boot-default-1774706468152.jpg saved to cache
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12179919.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c78010e-b3c7-5416-83d2-7f16a50a9218 with identifier: 12179919
2026-03-29 20:29:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c78010e-b3c7-5416-83d2-7f16a50a9218 with scrape type 1
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_front_driver-1774628845778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_driver-1774628845778.jpg not downloaded yet
2026-03-29 20:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-instrument_cluster-default-1774706625609.jpg> (referer: None)
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_rear_driver-1774628868070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_driver-1774628868070.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_front_passenger-1774628907027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_passenger-1774628907027.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_rear_passenger-1774628888871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_passenger-1774628888871.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9919%252F12179919%252Finterior_front_seats-1774629539723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9919/12179919/interior_front_seats-1774629539723.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9919%252F12179919%252Finterior_rear_seats-1774629565208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9919/12179919/interior_rear_seats-1774629565208.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9919%252F12179919%252Finterior_dashboard-1774630312261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9919/12179919/interior_dashboard-1774630312261.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Finstrument_cluster-1774629636491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/instrument_cluster-1774629636491.jpg not downloaded yet
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01510>
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-instrument_cluster-default-1774706625609.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-instrument_cluster-default-1774706625609.jpg saved to cache
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9919%252F12179919%252Finterior_boot-1774629635285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9919/12179919/interior_boot-1774629635285.jpg not downloaded yet
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9919%252F12179919%252Fdocs_service_history-1774629715668.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfe9345151497220db530ade7ffd68641%27 HTTP/1.1" 200 None
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9919/12179919/docs_service_history-1774629715668.jpg?ixlib=js-3.8.0&auto=format&s=fe9345151497220db530ade7ffd68641 not downloaded yet
2026-03-29 20:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-interior_dashboard-default-1774706482676.jpg> (referer: None)
2026-03-29 20:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_driver-1774628845778.jpg> (referer: None)
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d270ad0>
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-interior_dashboard-default-1774706482676.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-interior_dashboard-default-1774706482676.jpg saved to cache
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a0110>
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_front_driver-1774628845778.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_driver-1774628845778.jpg saved to cache
2026-03-29 20:29:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9919/12179919/interior_boot-1774629635285.jpg> (referer: None)
2026-03-29 20:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9919/12179919/docs_service_history-1774629715668.jpg?ixlib=js-3.8.0&auto=format&s=fe9345151497220db530ade7ffd68641> (referer: None)
2026-03-29 20:29:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c212650>
2026-03-29 20:29:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9919%252F12179919%252Finterior_boot-1774629635285.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9919/12179919/interior_boot-1774629635285.jpg saved to cache
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadfad0>
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9919%252F12179919%252Fdocs_service_history-1774629715668.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfe9345151497220db530ade7ffd68641') HTTP/1.1" 204 0
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9919/12179919/docs_service_history-1774629715668.jpg?ixlib=js-3.8.0&auto=format&s=fe9345151497220db530ade7ffd68641 saved to cache
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9919/12179919/instrument_cluster-1774629636491.jpg> (referer: None)
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a0710>
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Finstrument_cluster-1774629636491.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/instrument_cluster-1774629636491.jpg saved to cache
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9919/12179919/interior_dashboard-1774630312261.jpg> (referer: None)
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadde50>
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9919%252F12179919%252Finterior_dashboard-1774630312261.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9919/12179919/interior_dashboard-1774630312261.jpg saved to cache
2026-03-29 20:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9919/12179919/interior_front_seats-1774629539723.jpg> (referer: None)
2026-03-29 20:29:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9919/12179919/interior_rear_seats-1774629565208.jpg> (referer: None)
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7d3ad0>
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9919%252F12179919%252Finterior_front_seats-1774629539723.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9919/12179919/interior_front_seats-1774629539723.jpg saved to cache
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a3dd0>
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9919%252F12179919%252Finterior_rear_seats-1774629565208.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9919/12179919/interior_rear_seats-1774629565208.jpg saved to cache
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_passenger-1774628888871.jpg> (referer: None)
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadfb50>
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_rear_passenger-1774628888871.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_passenger-1774628888871.jpg saved to cache
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_passenger-1774628907027.jpg> (referer: None)
2026-03-29 20:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_driver-1774628868070.jpg> (referer: None)
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7d3810>
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_front_passenger-1774628907027.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_passenger-1774628907027.jpg saved to cache
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d33d650>
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9919%252F12179919%252Fexterior_rear_driver-1774628868070.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_driver-1774628868070.jpg saved to cache
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c78010e-b3c7-5416-83d2-7f16a50a9218
2026-03-29 20:29:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c78010e-b3c7-5416-83d2-7f16a50a9218, skipping ID generation
2026-03-29 20:29:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c78010e-b3c7-5416-83d2-7f16a50a9218 with scrape type 1
2026-03-29 20:29:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c78010e-b3c7-5416-83d2-7f16a50a9218 sending to next pipeline
2026-03-29 20:29:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0c78010e-b3c7-5416-83d2-7f16a50a9218, identifier: 12179919
2026-03-29 20:29:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0c78010e-b3c7-5416-83d2-7f16a50a9218 with identifier: 12179919
2026-03-29 20:29:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0c78010e-b3c7-5416-83d2-7f16a50a9218 with identifier: 12179919
2026-03-29 20:29:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0c78010e-b3c7-5416-83d2-7f16a50a9218 with identifier: 12179919 to the API
2026-03-29 20:29:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_driver-1774628868070.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0c78010e-b3c7-5416-83d2-7f16a50a9218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'K44 MXC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12179919',
'listing': 'auction',
'location': 'Luton Luton',
'make': 'BMW',
'model': '5 Series',
'odometer': 47966,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1331856,
'Height': 2267,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_driver-1774628845778.jpg',
'Width': 3023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2454174,
'Height': 2991,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_driver-1774628868070.jpg',
'Width': 3988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2006655,
'Height': 2752,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_front_passenger-1774628907027.jpg',
'Width': 3669},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2381053,
'Height': 2863,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9919/12179919/exterior_rear_passenger-1774628888871.jpg',
'Width': 3817},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3822669,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9919/12179919/interior_front_seats-1774629539723.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3686206,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9919/12179919/interior_rear_seats-1774629565208.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2793946,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9919/12179919/interior_dashboard-1774630312261.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2371073,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9919/12179919/instrument_cluster-1774629636491.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4115590,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9919/12179919/interior_boot-1774629635285.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c78010e-b3c7-5416-83d2-7f16a50a9218/0c78010e-b3c7-5416-83d2-7f16a50a9218_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7647752,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9919/12179919/docs_service_history-1774629715668.jpg?ixlib=js-3.8.0&auto=format&s=fe9345151497220db530ade7ffd68641',
'Width': 5712}],
'price': 12549,
'price_includes_vat': False,
'registration_date': '2018-12-14',
'seats_number': None,
'seller_name': None,
'title': 'BMW 520I M Sport Auto',
'transmission': 'automatic',
'trim': '520I M Sport Auto',
'vin': 'WBAJK52060BN95527',
'year': 2018}
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712179919%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [motorway.uk] INFO: Saving data for 12179919: {'created_time': 1774816162.230479, 'last_price_update_time': 1774816162.230489, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12179919') HTTP/1.1" 204 0
2026-03-29 20:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4016/18264016/18264016-interior_front_seats-default-1774706472738.jpg> (referer: None)
2026-03-29 20:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4016/18264016/18264016-interior_rear_seats-default-1774706471168.jpg> (referer: None)
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caddbd0>
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4016%252F18264016%252F18264016-interior_front_seats-default-1774706472738.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4016/18264016/18264016-interior_front_seats-default-1774706472738.jpg saved to cache
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d197850>
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4016%252F18264016%252F18264016-interior_rear_seats-default-1774706471168.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4016/18264016/18264016-interior_rear_seats-default-1774706471168.jpg saved to cache
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15783679.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_passenger-default-1774706463956.jpg> (referer: None)
2026-03-29 20:29:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a77ecd02-c6da-5e2f-9a16-fad7dd51f181 with identifier: 15783679
2026-03-29 20:29:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181 with scrape type 1
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_front_driver-1774718236065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_driver-1774718236065.jpg not downloaded yet
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_rear_driver-1774718405382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_driver-1774718405382.jpg not downloaded yet
2026-03-29 20:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_passenger-default-1774706463829.jpg> (referer: None)
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_front_passenger-1774718265707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_passenger-1774718265707.jpg not downloaded yet
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_rear_passenger-1774718313241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_passenger-1774718313241.jpg not downloaded yet
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3679%252F15783679%252Finterior_front_seats-1774718441452.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3679/15783679/interior_front_seats-1774718441452.jpg not downloaded yet
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf05bd0>
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_front_passenger-default-1774706463956.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_passenger-default-1774706463956.jpg saved to cache
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3679%252F15783679%252Finterior_rear_seats-1774718561246.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3679/15783679/interior_rear_seats-1774718561246.jpg not downloaded yet
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Finterior_dashboard-1774718643914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/interior_dashboard-1774718643914.jpg not downloaded yet
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c255f50>
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_rear_passenger-default-1774706463829.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_passenger-default-1774706463829.jpg saved to cache
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3679%252F15783679%252F15783679-instrument_cluster-modified-1774772196358.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3679/15783679/15783679-instrument_cluster-modified-1774772196358.jpeg not downloaded yet
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3679%252F15783679%252Finterior_boot-1774718600823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3679/15783679/interior_boot-1774718600823.jpg not downloaded yet
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3679%252F15783679%252F15783679-docs_service_history-default-1751900404683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D957d265419c30714505ff03736eb90b5%27 HTTP/1.1" 200 None
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3679/15783679/15783679-docs_service_history-default-1751900404683.jpg?ixlib=js-3.8.0&auto=format&s=957d265419c30714505ff03736eb90b5 not downloaded yet
2026-03-29 20:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_driver-default-1774706464663.jpg> (referer: None)
2026-03-29 20:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_driver-1774718405382.jpg> (referer: None)
2026-03-29 20:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_driver-default-1774706463954.jpg> (referer: None)
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e093610>
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_front_driver-default-1774706464663.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_driver-default-1774706464663.jpg saved to cache
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0e9e10>
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_rear_driver-1774718405382.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_driver-1774718405382.jpg saved to cache
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6eb10>
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4016%252F18264016%252F18264016-exterior_rear_driver-default-1774706463954.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_driver-default-1774706463954.jpg saved to cache
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d090ae62-467e-5a7e-b7f4-15bbea9800ec
2026-03-29 20:29:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d090ae62-467e-5a7e-b7f4-15bbea9800ec, skipping ID generation
2026-03-29 20:29:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d090ae62-467e-5a7e-b7f4-15bbea9800ec with scrape type 1
2026-03-29 20:29:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d090ae62-467e-5a7e-b7f4-15bbea9800ec sending to next pipeline
2026-03-29 20:29:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d090ae62-467e-5a7e-b7f4-15bbea9800ec, identifier: 18264016
2026-03-29 20:29:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d090ae62-467e-5a7e-b7f4-15bbea9800ec with identifier: 18264016
2026-03-29 20:29:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d090ae62-467e-5a7e-b7f4-15bbea9800ec with identifier: 18264016
2026-03-29 20:29:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d090ae62-467e-5a7e-b7f4-15bbea9800ec with identifier: 18264016 to the API
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_driver-default-1774706463954.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd090ae62-467e-5a7e-b7f4-15bbea9800ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP21 BZA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18264016',
'listing': 'auction',
'location': 'Tyne and Wear South Shields',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 37000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1882614,
'Height': 2305,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_driver-default-1774706464663.jpg',
'Width': 3073},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2136996,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_driver-default-1774706463954.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201916,
'Height': 2567,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_front_passenger-default-1774706463956.jpg',
'Width': 3423},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2176849,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-exterior_rear_passenger-default-1774706463829.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467880,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4016/18264016/18264016-interior_front_seats-default-1774706472738.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2462523,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4016/18264016/18264016-interior_rear_seats-default-1774706471168.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2086710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-interior_dashboard-default-1774706482676.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928981,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4016/18264016/18264016-instrument_cluster-default-1774706625609.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1678917,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4016/18264016/18264016-interior_boot-default-1774706468152.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d090ae62-467e-5a7e-b7f4-15bbea9800ec/d090ae62-467e-5a7e-b7f4-15bbea9800ec_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 11297003,
'Height': 3042,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4016/18264016/18264016-docs_service_history-modified-1764601009811.png?ixlib=js-3.8.0&auto=format&s=0222ec60c596c1e73fd956843d36b9c3',
'Width': 4057}],
'price': 17296,
'price_includes_vat': False,
'registration_date': '2021-05-21',
'seats_number': None,
'seller_name': None,
'title': 'Ford Galaxy Titanium Ecoblue Auto',
'transmission': 'automatic',
'trim': 'Titanium Ecoblue Auto',
'vin': 'WF0KXXWPCKMM02485',
'year': 2021}
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718264016%27 HTTP/1.1" 200 None
2026-03-29 20:29:23 [motorway.uk] INFO: Saving data for 18264016: {'created_time': 1774816163.978819, 'last_price_update_time': 1774816163.978833, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18264016') HTTP/1.1" 204 0
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3679/15783679/interior_boot-1774718600823.jpg> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/3679/15783679/15783679-docs_service_history-default-1751900404683.jpg?ixlib=js-3.8.0&auto=format&s=957d265419c30714505ff03736eb90b5> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3679/15783679/15783679-instrument_cluster-modified-1774772196358.jpeg> (referer: None)
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12ec10>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3679%252F15783679%252Finterior_boot-1774718600823.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3679/15783679/interior_boot-1774718600823.jpg saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6de90>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3679%252F15783679%252F15783679-docs_service_history-default-1751900404683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D957d265419c30714505ff03736eb90b5') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3679/15783679/15783679-docs_service_history-default-1751900404683.jpg?ixlib=js-3.8.0&auto=format&s=957d265419c30714505ff03736eb90b5 saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03a050>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3679%252F15783679%252F15783679-instrument_cluster-modified-1774772196358.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3679/15783679/15783679-instrument_cluster-modified-1774772196358.jpeg saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3679/15783679/interior_front_seats-1774718441452.jpg> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3679/15783679/interior_rear_seats-1774718561246.jpg> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3679/15783679/interior_dashboard-1774718643914.jpg> (referer: None)
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec07990>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3679%252F15783679%252Finterior_front_seats-1774718441452.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3679/15783679/interior_front_seats-1774718441452.jpg saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d205990>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3679%252F15783679%252Finterior_rear_seats-1774718561246.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3679/15783679/interior_rear_seats-1774718561246.jpg saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6cfd0>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Finterior_dashboard-1774718643914.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/interior_dashboard-1774718643914.jpg saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_driver-1774718236065.jpg> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_passenger-1774718265707.jpg> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_passenger-1774718313241.jpg> (referer: None)
2026-03-29 20:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20491744.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec1e550>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_front_driver-1774718236065.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_driver-1774718236065.jpg saved to cache
2026-03-29 20:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2055d0>
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_front_passenger-1774718265707.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_passenger-1774718265707.jpg saved to cache
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d103950>
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3679%252F15783679%252Fexterior_rear_passenger-1774718313241.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_passenger-1774718313241.jpg saved to cache
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181
2026-03-29 20:29:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a77ecd02-c6da-5e2f-9a16-fad7dd51f181, skipping ID generation
2026-03-29 20:29:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181 with scrape type 1
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a77ecd02-c6da-5e2f-9a16-fad7dd51f181 sending to next pipeline
2026-03-29 20:29:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a77ecd02-c6da-5e2f-9a16-fad7dd51f181, identifier: 15783679
2026-03-29 20:29:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 with identifier: 20491744
2026-03-29 20:29:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 with scrape type 1
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_front_driver-1774776416766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_driver-1774776416766.jpg not downloaded yet
2026-03-29 20:29:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a77ecd02-c6da-5e2f-9a16-fad7dd51f181 with identifier: 15783679
2026-03-29 20:29:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a77ecd02-c6da-5e2f-9a16-fad7dd51f181 with identifier: 15783679
2026-03-29 20:29:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a77ecd02-c6da-5e2f-9a16-fad7dd51f181 with identifier: 15783679 to the API
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_passenger-1774718313241.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a77ecd02-c6da-5e2f-9a16-fad7dd51f181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY23 PYD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15783679',
'listing': 'auction',
'location': 'West Midlands Coventry',
'make': 'Ford',
'model': 'Puma',
'odometer': 10485,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697084,
'Height': 1953,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_driver-1774718236065.jpg',
'Width': 2604},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1204152,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_driver-1774718405382.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1390809,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_front_passenger-1774718265707.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 968602,
'Height': 2258,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3679/15783679/exterior_rear_passenger-1774718313241.jpg',
'Width': 3010},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1315975,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/3679/15783679/interior_front_seats-1774718441452.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1416126,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/3679/15783679/interior_rear_seats-1774718561246.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1265009,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3679/15783679/interior_dashboard-1774718643914.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1377257,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3679/15783679/15783679-instrument_cluster-modified-1774772196358.jpeg',
'Width': 3438},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1592339,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/3679/15783679/interior_boot-1774718600823.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a77ecd02-c6da-5e2f-9a16-fad7dd51f181/a77ecd02-c6da-5e2f-9a16-fad7dd51f181_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 904913,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3679/15783679/15783679-docs_service_history-default-1751900404683.jpg?ixlib=js-3.8.0&auto=format&s=957d265419c30714505ff03736eb90b5',
'Width': 3000}],
'price': 16255,
'price_includes_vat': False,
'registration_date': '2023-05-19',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma ST-LINE Vignale MHEV',
'transmission': 'manual',
'trim': 'ST-LINE Vignale MHEV',
'vin': 'WF02XXERK2PC57370',
'year': 2023}
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715783679%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [motorway.uk] INFO: Saving data for 15783679: {'created_time': 1774816165.623925, 'last_price_update_time': 1774816165.623936, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15783679') HTTP/1.1" 204 0
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_rear_driver-1774776434334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_driver-1774776434334.jpg not downloaded yet
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_front_passenger-1774776468187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_passenger-1774776468187.jpg not downloaded yet
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_rear_passenger-1774776537498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_passenger-1774776537498.jpg not downloaded yet
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1744%252F20491744%252Finterior_front_seats-1774777166670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1744/20491744/interior_front_seats-1774777166670.jpg not downloaded yet
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1744%252F20491744%252Finterior_rear_seats-1774777191132.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1744/20491744/interior_rear_seats-1774777191132.jpg not downloaded yet
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1744%252F20491744%252Finterior_dashboard-1774788269091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1744/20491744/interior_dashboard-1774788269091.jpg not downloaded yet
2026-03-29 20:29:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_driver-1774618915402.jpg> (referer: None)
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1744%252F20491744%252Finstrument_cluster-1774788726601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1744/20491744/instrument_cluster-1774788726601.jpg not downloaded yet
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1744%252F20491744%252Finterior_boot-1774777298539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1744/20491744/interior_boot-1774777298539.jpg not downloaded yet
2026-03-29 20:29:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_passenger-1774618959523.jpg> (referer: None)
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fwheels_front_driver-1774776699701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/wheels_front_driver-1774776699701.jpg not downloaded yet
2026-03-29 20:29:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_passenger-1774618744171.jpg> (referer: None)
2026-03-29 20:29:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8854/16548854/interior_front_seats-1774621052776.jpg> (referer: None)
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e03c3d0>
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_rear_driver-1774618915402.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_driver-1774618915402.jpg saved to cache
2026-03-29 20:29:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07d10>
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_rear_passenger-1774618959523.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_passenger-1774618959523.jpg saved to cache
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ed850>
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_front_passenger-1774618744171.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_passenger-1774618744171.jpg saved to cache
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6b6e10>
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8854%252F16548854%252Finterior_front_seats-1774621052776.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8854/16548854/interior_front_seats-1774621052776.jpg saved to cache
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1744/20491744/instrument_cluster-1774788726601.jpg> (referer: None)
2026-03-29 20:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1744/20491744/wheels_front_driver-1774776699701.jpg> (referer: None)
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba4dd0>
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1744%252F20491744%252Finstrument_cluster-1774788726601.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1744/20491744/instrument_cluster-1774788726601.jpg saved to cache
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c212350>
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fwheels_front_driver-1774776699701.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/wheels_front_driver-1774776699701.jpg saved to cache
2026-03-29 20:29:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1744/20491744/interior_rear_seats-1774777191132.jpg> (referer: None)
2026-03-29 20:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1744/20491744/interior_boot-1774777298539.jpg> (referer: None)
2026-03-29 20:29:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c212990>
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1744%252F20491744%252Finterior_rear_seats-1774777191132.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1744/20491744/interior_rear_seats-1774777191132.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba61d0>
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1744%252F20491744%252Finterior_boot-1774777298539.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1744/20491744/interior_boot-1774777298539.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1744/20491744/interior_dashboard-1774788269091.jpg> (referer: None)
2026-03-29 20:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1744/20491744/interior_front_seats-1774777166670.jpg> (referer: None)
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c273310>
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1744%252F20491744%252Finterior_dashboard-1774788269091.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1744/20491744/interior_dashboard-1774788269091.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce49e10>
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1744%252F20491744%252Finterior_front_seats-1774777166670.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1744/20491744/interior_front_seats-1774777166670.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_passenger-1774776468187.jpg> (referer: None)
2026-03-29 20:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_passenger-1774776537498.jpg> (referer: None)
2026-03-29 20:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_driver-1774776434334.jpg> (referer: None)
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba6810>
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_front_passenger-1774776468187.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_passenger-1774776468187.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca18ed0>
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_rear_passenger-1774776537498.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_passenger-1774776537498.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbe8e50>
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_rear_driver-1774776434334.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_driver-1774776434334.jpg saved to cache
2026-03-29 20:29:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_driver-1774618747443.jpg> (referer: None)
2026-03-29 20:29:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_driver-1774776416766.jpg> (referer: None)
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed78c90>
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8854%252F16548854%252Fexterior_front_driver-1774618747443.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_driver-1774618747443.jpg saved to cache
2026-03-29 20:29:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb
2026-03-29 20:29:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b6c108b-36d1-5afe-a00d-466d8dca6ecb, skipping ID generation
2026-03-29 20:29:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb with scrape type 1
2026-03-29 20:29:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b6c108b-36d1-5afe-a00d-466d8dca6ecb sending to next pipeline
2026-03-29 20:29:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7b6c108b-36d1-5afe-a00d-466d8dca6ecb, identifier: 16548854
2026-03-29 20:29:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7b6c108b-36d1-5afe-a00d-466d8dca6ecb with identifier: 16548854
2026-03-29 20:29:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7b6c108b-36d1-5afe-a00d-466d8dca6ecb with identifier: 16548854
2026-03-29 20:29:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7b6c108b-36d1-5afe-a00d-466d8dca6ecb with identifier: 16548854 to the API
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_driver-1774618747443.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '7b6c108b-36d1-5afe-a00d-466d8dca6ecb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA20 NSY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16548854',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Honda',
'model': 'Jazz',
'odometer': 55680,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488223,
'Height': 2345,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_driver-1774618747443.jpg',
'Width': 3127},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742436,
'Height': 2168,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_driver-1774618915402.jpg',
'Width': 2891},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1587009,
'Height': 2832,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_front_passenger-1774618744171.jpg',
'Width': 3776},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1070387,
'Height': 2360,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8854/16548854/exterior_rear_passenger-1774618959523.jpg',
'Width': 3147},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2044715,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8854/16548854/interior_front_seats-1774621052776.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4741045,
'Height': 4000,
'OriginUrl': 'https://motorway-photos.imgix.net/8854/16548854/interior_rear_seats-1774687751607.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1767877,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8854/16548854/interior_dashboard-1774625474813.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1186186,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8854/16548854/instrument_cluster-1774631624759.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3000621,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8854/16548854/interior_boot-1774621057819.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b6c108b-36d1-5afe-a00d-466d8dca6ecb/7b6c108b-36d1-5afe-a00d-466d8dca6ecb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3569984,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8854/16548854/docs_service_history-1774687758089.jpg?ixlib=js-3.8.0&auto=format&s=6603c0f580925ad0afd244ba1bc3a4c0',
'Width': 4000}],
'price': 10972,
'price_includes_vat': False,
'registration_date': '2020-07-30',
'seats_number': None,
'seller_name': None,
'title': 'Honda Jazz SE I-MMD CVT',
'transmission': 'automatic',
'trim': 'SE I-MMD CVT',
'vin': 'JHMGR3830MS200362',
'year': 2020}
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716548854%27 HTTP/1.1" 200 None
2026-03-29 20:29:28 [motorway.uk] INFO: Saving data for 16548854: {'created_time': 1774816168.677748, 'last_price_update_time': 1774816168.677764, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16548854') HTTP/1.1" 204 0
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d288290>
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1744%252F20491744%252Fexterior_front_driver-1774776416766.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_driver-1774776416766.jpg saved to cache
2026-03-29 20:29:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1
2026-03-29 20:29:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1, skipping ID generation
2026-03-29 20:29:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 with scrape type 1
2026-03-29 20:29:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 sending to next pipeline
2026-03-29 20:29:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1, identifier: 20491744
2026-03-29 20:29:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 with identifier: 20491744
2026-03-29 20:29:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 with identifier: 20491744
2026-03-29 20:29:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1d01630d-51c1-5d5f-80af-ffb62d2fa6a1 with identifier: 20491744 to the API
2026-03-29 20:29:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_driver-1774776416766.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1d01630d-51c1-5d5f-80af-ffb62d2fa6a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'C3 PAU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20491744',
'listing': 'auction',
'location': 'Darlington Darlington',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 23037,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 863189,
'Height': 2022,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_driver-1774776416766.jpg',
'Width': 2696},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1680297,
'Height': 2601,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_driver-1774776434334.jpg',
'Width': 3468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1415644,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_front_passenger-1774776468187.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1720200,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1744/20491744/exterior_rear_passenger-1774776537498.jpg',
'Width': 3587},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5443297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1744/20491744/interior_front_seats-1774777166670.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5270290,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1744/20491744/interior_rear_seats-1774777191132.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421006,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1744/20491744/interior_dashboard-1774788269091.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1491201,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1744/20491744/instrument_cluster-1774788726601.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4257773,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1744/20491744/interior_boot-1774777298539.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01630d-51c1-5d5f-80af-ffb62d2fa6a1/1d01630d-51c1-5d5f-80af-ffb62d2fa6a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1904636,
'Height': 2964,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1744/20491744/wheels_front_driver-1774776699701.jpg',
'Width': 3952}],
'price': 24690,
'price_includes_vat': False,
'registration_date': '2021-08-17',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf GTI TSI S-A',
'transmission': 'automatic',
'trim': 'GTI TSI S-A',
'vin': 'WVWZZZCDZMW117970',
'year': 2021}
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491744%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [motorway.uk] INFO: Saving data for 20491744: {'created_time': 1774816169.221543, 'last_price_update_time': 1774816169.221554, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20491744') HTTP/1.1" 204 0
2026-03-29 20:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9480/19569480/exterior_front_passenger-1771872519402.jpg> (referer: None)
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed7b750>
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9480%252F19569480%252Fexterior_front_passenger-1771872519402.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9480/19569480/exterior_front_passenger-1771872519402.jpg saved to cache
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17291886.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e188de7b-cb2f-5008-83c2-b19774dc99f6 with identifier: 17291886
2026-03-29 20:29:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e188de7b-cb2f-5008-83c2-b19774dc99f6 with scrape type 1
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_front_driver-1774607422623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_driver-1774607422623.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_rear_driver-1774624044257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_driver-1774624044257.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_front_passenger-1774624109506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_passenger-1774624109506.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_rear_passenger-1774624062801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_passenger-1774624062801.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F17291886%252Finterior_front_seats-1774621927223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/17291886/interior_front_seats-1774621927223.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F17291886%252Finterior_rear_seats-1774617955740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/17291886/interior_rear_seats-1774617955740.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Finterior_dashboard-1774622032697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/interior_dashboard-1774622032697.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Finstrument_cluster-1774618026154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/instrument_cluster-1774618026154.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F17291886%252Finterior_boot-1774621872788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/17291886/interior_boot-1774621872788.jpg not downloaded yet
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1886%252F17291886%252Fdocs_service_history-1774626809676.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2736802572acbfa65e521d02f681fb9a%27 HTTP/1.1" 200 None
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1886/17291886/docs_service_history-1774626809676.jpg?ixlib=js-3.8.0&auto=format&s=2736802572acbfa65e521d02f681fb9a not downloaded yet
2026-03-29 20:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_front_driver-1771862382983.jpg> (referer: None)
2026-03-29 20:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_driver-1771862416395.jpg> (referer: None)
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca24350>
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9480%252F19569480%252Fexterior_front_driver-1771862382983.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_front_driver-1771862382983.jpg saved to cache
2026-03-29 20:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea55e10>
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9480%252F19569480%252Fexterior_rear_driver-1771862416395.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_driver-1771862416395.jpg saved to cache
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6
2026-03-29 20:29:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91bb2bed-db42-5f30-a982-5bd0ac8107a6, skipping ID generation
2026-03-29 20:29:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6 with scrape type 1
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91bb2bed-db42-5f30-a982-5bd0ac8107a6 sending to next pipeline
2026-03-29 20:29:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 91bb2bed-db42-5f30-a982-5bd0ac8107a6, identifier: 19569480
2026-03-29 20:29:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 91bb2bed-db42-5f30-a982-5bd0ac8107a6 with identifier: 19569480
2026-03-29 20:29:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 91bb2bed-db42-5f30-a982-5bd0ac8107a6 with identifier: 19569480
2026-03-29 20:29:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 91bb2bed-db42-5f30-a982-5bd0ac8107a6 with identifier: 19569480 to the API
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_driver-1771862416395.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '91bb2bed-db42-5f30-a982-5bd0ac8107a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LX22 JVK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19569480',
'listing': 'auction',
'location': 'Greater London London',
'make': 'BMW',
'model': 'M3',
'odometer': 49500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1710418,
'Height': 2491,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_front_driver-1771862382983.jpg',
'Width': 3321},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2131456,
'Height': 2742,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_driver-1771862416395.jpg',
'Width': 3656},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379549,
'Height': 2742,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9480/19569480/exterior_front_passenger-1771872519402.jpg',
'Width': 3656},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1590109,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9480/19569480/exterior_rear_passenger-1771862466620.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2422462,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9480/19569480/interior_rear_seats-1771862906110.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3132141,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9480/19569480/interior_dashboard-1771872496496.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3592470,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9480/19569480/interior_boot-1771862968564.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49036,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/9480/19569480/docs_service_history-1771863121168.jpg?ixlib=js-3.8.0&auto=format&s=c3ce23dd2cbffb21f32a702c67fa8310',
'Width': 596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91bb2bed-db42-5f30-a982-5bd0ac8107a6/91bb2bed-db42-5f30-a982-5bd0ac8107a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3115028,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9480/19569480/damage_scratches-1771862555551.jpg',
'Width': 4032}],
'price': 28267,
'price_includes_vat': False,
'registration_date': '2022-07-11',
'seats_number': None,
'seller_name': None,
'title': 'BMW M340I xDrive MHEV Auto',
'transmission': 'automatic',
'trim': '40I xDrive MHEV Auto',
'vin': 'WBA5U92080FN23174',
'year': 2022}
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719569480%27 HTTP/1.1" 200 None
2026-03-29 20:29:30 [motorway.uk] INFO: Saving data for 19569480: {'created_time': 1774816170.608557, 'last_price_update_time': 1774816170.608569, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19569480') HTTP/1.1" 204 0
2026-03-29 20:29:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1886/17291886/docs_service_history-1774626809676.jpg?ixlib=js-3.8.0&auto=format&s=2736802572acbfa65e521d02f681fb9a> (referer: None)
2026-03-29 20:29:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1886/17291886/interior_boot-1774621872788.jpg> (referer: None)
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22e0d0>
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1886%252F17291886%252Fdocs_service_history-1774626809676.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2736802572acbfa65e521d02f681fb9a') HTTP/1.1" 204 0
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1886/17291886/docs_service_history-1774626809676.jpg?ixlib=js-3.8.0&auto=format&s=2736802572acbfa65e521d02f681fb9a saved to cache
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1ebd0>
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F17291886%252Finterior_boot-1774621872788.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/17291886/interior_boot-1774621872788.jpg saved to cache
2026-03-29 20:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1886/17291886/instrument_cluster-1774618026154.jpg> (referer: None)
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed73250>
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Finstrument_cluster-1774618026154.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/instrument_cluster-1774618026154.jpg saved to cache
2026-03-29 20:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1886/17291886/interior_rear_seats-1774617955740.jpg> (referer: None)
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca25390>
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F17291886%252Finterior_rear_seats-1774617955740.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/17291886/interior_rear_seats-1774617955740.jpg saved to cache
2026-03-29 20:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1886/17291886/interior_dashboard-1774622032697.jpg> (referer: None)
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07e490>
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Finterior_dashboard-1774622032697.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/interior_dashboard-1774622032697.jpg saved to cache
2026-03-29 20:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_passenger-1774624062801.jpg> (referer: None)
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9d690>
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_rear_passenger-1774624062801.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_passenger-1774624062801.jpg saved to cache
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1886/17291886/interior_front_seats-1774621927223.jpg> (referer: None)
2026-03-29 20:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_passenger-1774624109506.jpg> (referer: None)
2026-03-29 20:29:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea55010>
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F17291886%252Finterior_front_seats-1774621927223.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/17291886/interior_front_seats-1774621927223.jpg saved to cache
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22fad0>
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_front_passenger-1774624109506.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_passenger-1774624109506.jpg saved to cache
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_driver-1774624044257.jpg> (referer: None)
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b4510>
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_rear_driver-1774624044257.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_driver-1774624044257.jpg saved to cache
2026-03-29 20:29:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_driver-1774607422623.jpg> (referer: None)
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1d250>
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F17291886%252Fexterior_front_driver-1774607422623.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_driver-1774607422623.jpg saved to cache
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e188de7b-cb2f-5008-83c2-b19774dc99f6
2026-03-29 20:29:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e188de7b-cb2f-5008-83c2-b19774dc99f6, skipping ID generation
2026-03-29 20:29:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e188de7b-cb2f-5008-83c2-b19774dc99f6 with scrape type 1
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e188de7b-cb2f-5008-83c2-b19774dc99f6 sending to next pipeline
2026-03-29 20:29:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e188de7b-cb2f-5008-83c2-b19774dc99f6, identifier: 17291886
2026-03-29 20:29:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e188de7b-cb2f-5008-83c2-b19774dc99f6 with identifier: 17291886
2026-03-29 20:29:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e188de7b-cb2f-5008-83c2-b19774dc99f6 with identifier: 17291886
2026-03-29 20:29:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e188de7b-cb2f-5008-83c2-b19774dc99f6 with identifier: 17291886 to the API
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_driver-1774607422623.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e188de7b-cb2f-5008-83c2-b19774dc99f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': '870 JTC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17291886',
'listing': 'auction',
'location': 'Greater Manchester Oldham',
'make': 'Hyundai',
'model': 'I20',
'odometer': 6513,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2874999,
'Height': 2967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_driver-1774607422623.jpg',
'Width': 3956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1040042,
'Height': 2071,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_driver-1774624044257.jpg',
'Width': 2761},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2382073,
'Height': 2989,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_front_passenger-1774624109506.jpg',
'Width': 3985},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616879,
'Height': 2604,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1886/17291886/exterior_rear_passenger-1774624062801.jpg',
'Width': 3472},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3549312,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1886/17291886/interior_front_seats-1774621927223.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3011741,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1886/17291886/interior_rear_seats-1774617955740.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3574842,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1886/17291886/interior_dashboard-1774622032697.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1435568,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1886/17291886/instrument_cluster-1774618026154.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4886907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1886/17291886/interior_boot-1774621872788.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188de7b-cb2f-5008-83c2-b19774dc99f6/e188de7b-cb2f-5008-83c2-b19774dc99f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1194937,
'Height': 2435,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1886/17291886/docs_service_history-1774626809676.jpg?ixlib=js-3.8.0&auto=format&s=2736802572acbfa65e521d02f681fb9a',
'Width': 3247}],
'price': 15453,
'price_includes_vat': False,
'registration_date': '2023-11-29',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I20 Premium T-GDi Auto',
'transmission': 'automatic',
'trim': 'Premium T-GDi Auto',
'vin': 'NLHBR51G7RZ394099',
'year': 2023}
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717291886%27 HTTP/1.1" 200 None
2026-03-29 20:29:33 [motorway.uk] INFO: Saving data for 17291886: {'created_time': 1774816173.55959, 'last_price_update_time': 1774816173.559604, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17291886') HTTP/1.1" 204 0
2026-03-29 20:29:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7789/17747789/interior_dashboard-1774536042669.jpg> (referer: None)
2026-03-29 20:29:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_driver-1774696608127.jpg> (referer: None)
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba9d50>
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Finterior_dashboard-1774536042669.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/interior_dashboard-1774536042669.jpg saved to cache
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d1a10>
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6570%252F6226570%252Fexterior_rear_driver-1774696608127.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_driver-1774696608127.jpg saved to cache
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a41575e-7263-555d-8fa2-0389cb95f3ba
2026-03-29 20:29:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a41575e-7263-555d-8fa2-0389cb95f3ba, skipping ID generation
2026-03-29 20:29:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a41575e-7263-555d-8fa2-0389cb95f3ba with scrape type 1
2026-03-29 20:29:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a41575e-7263-555d-8fa2-0389cb95f3ba sending to next pipeline
2026-03-29 20:29:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1a41575e-7263-555d-8fa2-0389cb95f3ba, identifier: 6226570
2026-03-29 20:29:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1a41575e-7263-555d-8fa2-0389cb95f3ba with identifier: 6226570
2026-03-29 20:29:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1a41575e-7263-555d-8fa2-0389cb95f3ba with identifier: 6226570
2026-03-29 20:29:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1a41575e-7263-555d-8fa2-0389cb95f3ba with identifier: 6226570 to the API
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_driver-1774696608127.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1a41575e-7263-555d-8fa2-0389cb95f3ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AJ21 XPX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6226570',
'listing': 'auction',
'location': 'West Sussex Bognor Regis',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 32800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1499950,
'Height': 2322,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_driver-1774696588598.jpg',
'Width': 3096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1090526,
'Height': 2038,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_driver-1774696608127.jpg',
'Width': 2717},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060973,
'Height': 2734,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_front_passenger-1774696637877.jpg',
'Width': 3645},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1636431,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6570/6226570/exterior_rear_passenger-1774696622686.jpg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4852758,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6570/6226570/interior_front_seats-1774697330858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4196696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6570/6226570/interior_rear_seats-1774697352296.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3164948,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6570/6226570/interior_dashboard-1774697431921.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2841093,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6570/6226570/interior_boot-1774697388825.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1333678,
'Height': 2001,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6570/6226570/docs_service_history-1774697678962.jpg?ixlib=js-3.8.0&auto=format&s=2433967ca2430d57796dcc182d6c3f26',
'Width': 911},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a41575e-7263-555d-8fa2-0389cb95f3ba/1a41575e-7263-555d-8fa2-0389cb95f3ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 20135,
'Height': 318,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6570/6226570/damage_scratches-1774698457558.jpg',
'Width': 424}],
'price': 7782,
'price_includes_vat': False,
'registration_date': '2021-07-26',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Aygo X-TREND TSS VVT-i',
'transmission': 'manual',
'trim': 'X-TREND TSS VVT-i',
'vin': 'JTDKGNEC00N640961',
'year': 2021}
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276226570%27 HTTP/1.1" 200 None
2026-03-29 20:29:34 [motorway.uk] INFO: Saving data for 6226570: {'created_time': 1774816174.456138, 'last_price_update_time': 1774816174.456147, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6226570') HTTP/1.1" 204 0
2026-03-29 20:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7789/17747789/interior_front_seats-1774535977099.jpg> (referer: None)
2026-03-29 20:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7789/17747789/interior_rear_seats-1774536087255.jpg> (referer: None)
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11b310>
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7789%252F17747789%252Finterior_front_seats-1774535977099.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7789/17747789/interior_front_seats-1774535977099.jpg saved to cache
2026-03-29 20:29:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d039250>
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7789%252F17747789%252Finterior_rear_seats-1774536087255.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7789/17747789/interior_rear_seats-1774536087255.jpg saved to cache
2026-03-29 20:29:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_passenger-1774534658586.jpg> (referer: None)
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11b690>
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_rear_passenger-1774534658586.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_passenger-1774534658586.jpg saved to cache
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_driver-1774534620664.jpg> (referer: None)
2026-03-29 20:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_passenger-1774535385486.jpg> (referer: None)
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d197a90>
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_rear_driver-1774534620664.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_driver-1774534620664.jpg saved to cache
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d0d90>
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_front_passenger-1774535385486.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_passenger-1774535385486.jpg saved to cache
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_driver-1774534608827.jpg> (referer: None)
2026-03-29 20:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_passenger-1774715452429.jpg> (referer: None)
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1972d0>
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7789%252F17747789%252Fexterior_front_driver-1774534608827.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_driver-1774534608827.jpg saved to cache
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7998cfe5-9b9c-5408-8866-2265342139a1
2026-03-29 20:29:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7998cfe5-9b9c-5408-8866-2265342139a1, skipping ID generation
2026-03-29 20:29:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7998cfe5-9b9c-5408-8866-2265342139a1 with scrape type 1
2026-03-29 20:29:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7998cfe5-9b9c-5408-8866-2265342139a1 sending to next pipeline
2026-03-29 20:29:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7998cfe5-9b9c-5408-8866-2265342139a1, identifier: 17747789
2026-03-29 20:29:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7998cfe5-9b9c-5408-8866-2265342139a1 with identifier: 17747789
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Orange+%26+Black HTTP/1.1" 200 None
2026-03-29 20:29:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:29:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7998cfe5-9b9c-5408-8866-2265342139a1 with identifier: 17747789
2026-03-29 20:29:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7998cfe5-9b9c-5408-8866-2265342139a1 with identifier: 17747789 to the API
2026-03-29 20:29:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_driver-1774534608827.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7998cfe5-9b9c-5408-8866-2265342139a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VO16 NUF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17747789',
'listing': 'auction',
'location': 'Cardiff Cardiff',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 49350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1437398,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_driver-1774534608827.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1509062,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_driver-1774534620664.jpg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2003705,
'Height': 2719,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_front_passenger-1774535385486.jpg',
'Width': 3625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1550047,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7789/17747789/exterior_rear_passenger-1774534658586.jpg',
'Width': 3385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3115007,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7789/17747789/interior_front_seats-1774535977099.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3135535,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7789/17747789/interior_rear_seats-1774536087255.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520740,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7789/17747789/interior_dashboard-1774536042669.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2542250,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7789/17747789/instrument_cluster-1774536082523.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3632984,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7789/17747789/interior_boot-1774536022388.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7998cfe5-9b9c-5408-8866-2265342139a1/7998cfe5-9b9c-5408-8866-2265342139a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2032755,
'Height': 2630,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7789/17747789/docs_service_history-1774536307316.jpg?ixlib=js-3.8.0&auto=format&s=a62af992773a4258fd4ed0598a974918',
'Width': 1876}],
'price': 9224,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Vitara SZ5 Rugged Allgrip Auto',
'transmission': 'automatic',
'trim': 'SZ5 Rugged Allgrip Auto',
'vin': 'TSMLYE21S00157191',
'year': 2016}
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717747789%27 HTTP/1.1" 200 None
2026-03-29 20:29:36 [motorway.uk] INFO: Saving data for 17747789: {'created_time': 1774816176.203323, 'last_price_update_time': 1774816176.203332, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17747789') HTTP/1.1" 204 0
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce38d10>
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_front_passenger-1774715452429.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_passenger-1774715452429.jpg saved to cache
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:29:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_driver-1774715378999.jpg> (referer: None)
2026-03-29 20:29:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_driver-1774715402093.jpg> (referer: None)
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed73e10>
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_front_driver-1774715378999.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_driver-1774715378999.jpg saved to cache
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca26bd0>
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F20460973%252Fexterior_rear_driver-1774715402093.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_driver-1774715402093.jpg saved to cache
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18716bff-94a4-5f11-b5b0-984e642a8257
2026-03-29 20:29:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18716bff-94a4-5f11-b5b0-984e642a8257, skipping ID generation
2026-03-29 20:29:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18716bff-94a4-5f11-b5b0-984e642a8257 with scrape type 1
2026-03-29 20:29:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18716bff-94a4-5f11-b5b0-984e642a8257 sending to next pipeline
2026-03-29 20:29:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 18716bff-94a4-5f11-b5b0-984e642a8257, identifier: 20460973
2026-03-29 20:29:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 18716bff-94a4-5f11-b5b0-984e642a8257 with identifier: 20460973
2026-03-29 20:29:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 18716bff-94a4-5f11-b5b0-984e642a8257 with identifier: 20460973
2026-03-29 20:29:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 18716bff-94a4-5f11-b5b0-984e642a8257 with identifier: 20460973 to the API
2026-03-29 20:29:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_driver-1774715402093.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '18716bff-94a4-5f11-b5b0-984e642a8257',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YY68 CLX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20460973',
'listing': 'auction',
'location': 'East Riding of Yorkshire Hessle',
'make': 'Jaguar',
'model': 'XF Series',
'odometer': 48939,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1399538,
'Height': 2031,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_driver-1774715378999.jpg',
'Width': 2708},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1496983,
'Height': 2125,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_driver-1774715402093.jpg',
'Width': 2833},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424840,
'Height': 2197,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_front_passenger-1774715452429.jpg',
'Width': 2929},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1376457,
'Height': 2100,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/20460973/exterior_rear_passenger-1774715428175.jpg',
'Width': 2800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3332087,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/20460973/interior_front_seats-1774717506538.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3960108,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0973/20460973/interior_rear_seats-1774716243455.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2887566,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/20460973/interior_dashboard-1774717521203.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3486692,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0973/20460973/interior_boot-1774716315169.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296353,
'Height': 1792,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0973/20460973/docs_service_history-1774716904447.jpg?ixlib=js-3.8.0&auto=format&s=ea4cddab67391e236c76fd8dfd2f4551',
'Width': 828},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18716bff-94a4-5f11-b5b0-984e642a8257/18716bff-94a4-5f11-b5b0-984e642a8257_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4399475,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0973/20460973/damage_scratches-1774715523618.jpg',
'Width': 4032}],
'price': 9904,
'price_includes_vat': False,
'registration_date': '2018-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XF R-Sport D Auto',
'transmission': 'automatic',
'trim': 'XF R-Sport D Auto',
'vin': 'SAJBB4AN6JCY64573',
'year': 2018}
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460973%27 HTTP/1.1" 200 None
2026-03-29 20:29:37 [motorway.uk] INFO: Saving data for 20460973: {'created_time': 1774816177.113673, 'last_price_update_time': 1774816177.113684, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20460973') HTTP/1.1" 204 0
2026-03-29 20:29:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5969/18505969/interior_front_seats-1774704230878.jpg> (referer: None)
2026-03-29 20:29:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/11558331/instrument_cluster-1774628460425.jpg> (referer: None)
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16e090>
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5969%252F18505969%252Finterior_front_seats-1774704230878.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5969/18505969/interior_front_seats-1774704230878.jpg saved to cache
2026-03-29 20:29:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58dfd0>
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Finstrument_cluster-1774628460425.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/instrument_cluster-1774628460425.jpg saved to cache
2026-03-29 20:29:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_passenger-1774703755927.jpg> (referer: None)
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16fdd0>
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_rear_passenger-1774703755927.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_passenger-1774703755927.jpg saved to cache
2026-03-29 20:29:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:29:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/11558331/interior_dashboard-1774628450003.jpg> (referer: None)
2026-03-29 20:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_passenger-1774703727125.jpg> (referer: None)
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce28f90>
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Finterior_dashboard-1774628450003.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/interior_dashboard-1774628450003.jpg saved to cache
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce289d0>
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_front_passenger-1774703727125.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_passenger-1774703727125.jpg saved to cache
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_driver-1774703678803.jpg> (referer: None)
2026-03-29 20:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/11558331/interior_rear_seats-1774628410802.jpg> (referer: None)
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16ef90>
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_rear_driver-1774703678803.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_driver-1774703678803.jpg saved to cache
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec9f7d0>
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F11558331%252Finterior_rear_seats-1774628410802.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/11558331/interior_rear_seats-1774628410802.jpg saved to cache
2026-03-29 20:29:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/11558331/interior_front_seats-1774628372471.jpg> (referer: None)
2026-03-29 20:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_driver-1774703650804.jpg> (referer: None)
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d1e10>
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F11558331%252Finterior_front_seats-1774628372471.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/11558331/interior_front_seats-1774628372471.jpg saved to cache
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58e890>
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5969%252F18505969%252Fexterior_front_driver-1774703650804.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_driver-1774703650804.jpg saved to cache
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69505459-81a0-5431-aa1e-5c0ed65da658
2026-03-29 20:29:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69505459-81a0-5431-aa1e-5c0ed65da658, skipping ID generation
2026-03-29 20:29:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69505459-81a0-5431-aa1e-5c0ed65da658 with scrape type 1
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69505459-81a0-5431-aa1e-5c0ed65da658 sending to next pipeline
2026-03-29 20:29:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 69505459-81a0-5431-aa1e-5c0ed65da658, identifier: 18505969
2026-03-29 20:29:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 69505459-81a0-5431-aa1e-5c0ed65da658 with identifier: 18505969
2026-03-29 20:29:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 69505459-81a0-5431-aa1e-5c0ed65da658 with identifier: 18505969
2026-03-29 20:29:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 69505459-81a0-5431-aa1e-5c0ed65da658 with identifier: 18505969 to the API
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_driver-1774703650804.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '69505459-81a0-5431-aa1e-5c0ed65da658',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CN20 ORU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18505969',
'listing': 'auction',
'location': 'Lincolnshire Lincoln',
'make': 'Ford',
'model': 'Ecosport',
'odometer': 35388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2288808,
'Height': 2933,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_driver-1774703650804.jpg',
'Width': 3911},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1754303,
'Height': 2597,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_driver-1774703678803.jpg',
'Width': 3463},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1778674,
'Height': 2688,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_front_passenger-1774703727125.jpg',
'Width': 3584},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1869420,
'Height': 2772,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5969/18505969/exterior_rear_passenger-1774703755927.jpg',
'Width': 3696},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3478357,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5969/18505969/interior_front_seats-1774704230878.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3414465,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5969/18505969/interior_rear_seats-1774704276035.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571397,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5969/18505969/interior_dashboard-1774708920339.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2394980,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5969/18505969/instrument_cluster-1774704268447.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3008157,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5969/18505969/interior_boot-1774704358754.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69505459-81a0-5431-aa1e-5c0ed65da658/69505459-81a0-5431-aa1e-5c0ed65da658_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47282,
'Height': 841,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5969/18505969/docs_service_history-1774706027906.jpg?ixlib=js-3.8.0&auto=format&s=d9ffb3beb464383595568b3eefe1bb86',
'Width': 595}],
'price': 7484,
'price_includes_vat': False,
'registration_date': '2020-07-15',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ecosport Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'vin': 'WF01XXERK1KM12103',
'year': 2020}
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718505969%27 HTTP/1.1" 200 None
2026-03-29 20:29:39 [motorway.uk] INFO: Saving data for 18505969: {'created_time': 1774816179.641668, 'last_price_update_time': 1774816179.641678, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18505969') HTTP/1.1" 204 0
2026-03-29 20:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_passenger-1774457797433.jpg> (referer: None)
2026-03-29 20:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_passenger-1774457811007.jpg> (referer: None)
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58f750>
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_rear_passenger-1774457797433.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_passenger-1774457797433.jpg saved to cache
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce29cd0>
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_front_passenger-1774457811007.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_passenger-1774457811007.jpg saved to cache
2026-03-29 20:29:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_driver-1774457787825.jpg> (referer: None)
2026-03-29 20:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_driver-1774457779902.jpg> (referer: None)
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca26a50>
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_rear_driver-1774457787825.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_driver-1774457787825.jpg saved to cache
2026-03-29 20:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03bcd0>
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F11558331%252Fexterior_front_driver-1774457779902.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_driver-1774457779902.jpg saved to cache
2026-03-29 20:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2
2026-03-29 20:29:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2, skipping ID generation
2026-03-29 20:29:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 with scrape type 1
2026-03-29 20:29:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 sending to next pipeline
2026-03-29 20:29:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2, identifier: 11558331
2026-03-29 20:29:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 with identifier: 11558331
2026-03-29 20:29:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 with identifier: 11558331
2026-03-29 20:29:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2eb1bdbb-2225-53e8-9d93-fbf665ed28f2 with identifier: 11558331 to the API
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_driver-1774457779902.jpg>
{'auction_title': '',
'category': None,
'color': 'Brown',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '2eb1bdbb-2225-53e8-9d93-fbf665ed28f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AF11 UNZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11558331',
'listing': 'auction',
'location': 'Oxfordshire Thame',
'make': 'Vauxhall',
'model': 'Meriva',
'odometer': 90414,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653927,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_driver-1774457779902.jpg',
'Width': 3258},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1228447,
'Height': 2380,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_driver-1774457787825.jpg',
'Width': 3173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1717382,
'Height': 2354,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_front_passenger-1774457811007.jpg',
'Width': 3138},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1558254,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8331/11558331/exterior_rear_passenger-1774457797433.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3874464,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8331/11558331/interior_front_seats-1774628372471.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3803184,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8331/11558331/interior_rear_seats-1774628410802.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1741530,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8331/11558331/interior_dashboard-1774628450003.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3014758,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8331/11558331/instrument_cluster-1774628460425.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3214877,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8331/11558331/interior_boot-1774628476447.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb1bdbb-2225-53e8-9d93-fbf665ed28f2/2eb1bdbb-2225-53e8-9d93-fbf665ed28f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1559087,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8331/11558331/docs_service_history-1774628720503.jpg?ixlib=js-3.8.0&auto=format&s=5947f55b1cc02794888c6067f4a9d5fb',
'Width': 3024}],
'price': 1336,
'price_includes_vat': False,
'registration_date': '2011-04-05',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Meriva SE CDTI Auto',
'transmission': 'automatic',
'trim': 'SE CDTI Auto',
'vin': 'W0LSH9EHXB4233351',
'year': 2011}
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711558331%27 HTTP/1.1" 200 None
2026-03-29 20:29:40 [motorway.uk] INFO: Saving data for 11558331: {'created_time': 1774816180.692461, 'last_price_update_time': 1774816180.692473, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11558331') HTTP/1.1" 204 0
2026-03-29 20:29:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.173(s), this was the 1st time calling it.
2026-03-29 20:29:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.657355788213135 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:29:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20406554.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 with identifier: 20406554
2026-03-29 20:29:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 with scrape type 1
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_front_driver-1774284494704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_driver-1774284494704.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_rear_driver-1774284515291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_driver-1774284515291.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_front_passenger-1774284567427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_passenger-1774284567427.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_rear_passenger-1774284540321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_passenger-1774284540321.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6554%252F20406554%252Finterior_front_seats-1774285418914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6554/20406554/interior_front_seats-1774285418914.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6554%252F20406554%252Finterior_rear_seats-1774285494879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6554/20406554/interior_rear_seats-1774285494879.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Finterior_dashboard-1774285965197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/interior_dashboard-1774285965197.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6554%252F20406554%252Finterior_boot-1774285629704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6554/20406554/interior_boot-1774285629704.jpg not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6554%252F20406554%252Fdocs_service_history-1774646762173.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1a117edf31e58f3dcb514856a977ef90%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646762173.jpg?ixlib=js-3.8.0&auto=format&s=1a117edf31e58f3dcb514856a977ef90 not downloaded yet
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6554%252F20406554%252Fdocs_service_history-1774646767439.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f695d038f70994118a05fc07529845c%27 HTTP/1.1" 200 None
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646767439.jpg?ixlib=js-3.8.0&auto=format&s=8f695d038f70994118a05fc07529845c not downloaded yet
2026-03-29 20:29:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20496248.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1882f3-6311-5dee-a846-323295996ddf with identifier: 20496248
2026-03-29 20:29:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1882f3-6311-5dee-a846-323295996ddf with scrape type 1
2026-03-29 20:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_front_driver-1774779579458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_driver-1774779579458.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_rear_driver-1774779573110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_driver-1774779573110.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_front_passenger-1774779585377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_passenger-1774779585377.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_rear_passenger-1774779628871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_passenger-1774779628871.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6248%252F20496248%252Finterior_front_seats-1774780834088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6248/20496248/interior_front_seats-1774780834088.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6248%252F20496248%252Finterior_rear_seats-1774780609347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6248/20496248/interior_rear_seats-1774780609347.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6248%252F20496248%252Finterior_dashboard-1774782005850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6248/20496248/interior_dashboard-1774782005850.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Finstrument_cluster-1774780534472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/instrument_cluster-1774780534472.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6248%252F20496248%252Finterior_boot-1774780551391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6248/20496248/interior_boot-1774780551391.jpg not downloaded yet
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6248%252F20496248%252Fdocs_service_history-1774780976740.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97ac84aa56246855d708ef4cb86a5d23%27 HTTP/1.1" 200 None
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6248/20496248/docs_service_history-1774780976740.jpg?ixlib=js-3.8.0&auto=format&s=97ac84aa56246855d708ef4cb86a5d23 not downloaded yet
2026-03-29 20:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646767439.jpg?ixlib=js-3.8.0&auto=format&s=8f695d038f70994118a05fc07529845c> (referer: None)
2026-03-29 20:29:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec8a9d0>
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6554%252F20406554%252Fdocs_service_history-1774646767439.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8f695d038f70994118a05fc07529845c') HTTP/1.1" 204 0
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646767439.jpg?ixlib=js-3.8.0&auto=format&s=8f695d038f70994118a05fc07529845c saved to cache
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6248/20496248/docs_service_history-1774780976740.jpg?ixlib=js-3.8.0&auto=format&s=97ac84aa56246855d708ef4cb86a5d23> (referer: None)
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7caed0>
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6248%252F20496248%252Fdocs_service_history-1774780976740.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97ac84aa56246855d708ef4cb86a5d23') HTTP/1.1" 204 0
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6248/20496248/docs_service_history-1774780976740.jpg?ixlib=js-3.8.0&auto=format&s=97ac84aa56246855d708ef4cb86a5d23 saved to cache
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6248/20496248/interior_boot-1774780551391.jpg> (referer: None)
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07950>
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6248%252F20496248%252Finterior_boot-1774780551391.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6248/20496248/interior_boot-1774780551391.jpg saved to cache
2026-03-29 20:29:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6248/20496248/instrument_cluster-1774780534472.jpg> (referer: None)
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec8a7d0>
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Finstrument_cluster-1774780534472.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/instrument_cluster-1774780534472.jpg saved to cache
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6248/20496248/interior_dashboard-1774782005850.jpg> (referer: None)
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119410>
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6248%252F20496248%252Finterior_dashboard-1774782005850.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6248/20496248/interior_dashboard-1774782005850.jpg saved to cache
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6248/20496248/interior_rear_seats-1774780609347.jpg> (referer: None)
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1fe50>
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6248%252F20496248%252Finterior_rear_seats-1774780609347.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6248/20496248/interior_rear_seats-1774780609347.jpg saved to cache
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6248/20496248/interior_front_seats-1774780834088.jpg> (referer: None)
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec8a890>
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6248%252F20496248%252Finterior_front_seats-1774780834088.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6248/20496248/interior_front_seats-1774780834088.jpg saved to cache
2026-03-29 20:29:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_passenger-1774779628871.jpg> (referer: None)
2026-03-29 20:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20327167.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c212010>
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_rear_passenger-1774779628871.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_passenger-1774779628871.jpg saved to cache
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b6947a-a254-55cb-aacb-2404cde9271a with identifier: 20327167
2026-03-29 20:29:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b6947a-a254-55cb-aacb-2404cde9271a with scrape type 1
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7167%252F20327167%252Fexterior_front_driver-1774719245843.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7167/20327167/exterior_front_driver-1774719245843.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-exterior_rear_driver-modified-1774778602682.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_driver-modified-1774778602682.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-exterior_front_passenger-modified-1774777105976.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_front_passenger-modified-1774777105976.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-exterior_rear_passenger-modified-1774777172498.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_passenger-modified-1774777172498.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_front_seats-modified-1774778418423.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_front_seats-modified-1774778418423.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_rear_seats-modified-1774777214520.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_rear_seats-modified-1774777214520.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_dashboard-modified-1774778406285.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_dashboard-modified-1774778406285.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7167%252F20327167%252Finstrument_cluster-1774719436219.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7167/20327167/instrument_cluster-1774719436219.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_boot-modified-1774776635057.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_boot-modified-1774776635057.jpeg not downloaded yet
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7167%252F20327167%252Fdocs_service_history-1774719134875.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D204b441d311f4de9163eb4d547d39dfc%27 HTTP/1.1" 200 None
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7167/20327167/docs_service_history-1774719134875.jpeg?ixlib=js-3.8.0&auto=format&s=204b441d311f4de9163eb4d547d39dfc not downloaded yet
2026-03-29 20:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_driver-1774779573110.jpg> (referer: None)
2026-03-29 20:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_passenger-1774779585377.jpg> (referer: None)
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01310>
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_rear_driver-1774779573110.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_driver-1774779573110.jpg saved to cache
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba4650>
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_front_passenger-1774779585377.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_passenger-1774779585377.jpg saved to cache
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7167/20327167/docs_service_history-1774719134875.jpeg?ixlib=js-3.8.0&auto=format&s=204b441d311f4de9163eb4d547d39dfc> (referer: None)
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca26cd0>
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7167%252F20327167%252Fdocs_service_history-1774719134875.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D204b441d311f4de9163eb4d547d39dfc') HTTP/1.1" 204 0
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7167/20327167/docs_service_history-1774719134875.jpeg?ixlib=js-3.8.0&auto=format&s=204b441d311f4de9163eb4d547d39dfc saved to cache
2026-03-29 20:29:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_boot-modified-1774776635057.jpeg> (referer: None)
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce23690>
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_boot-modified-1774776635057.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_boot-modified-1774776635057.jpeg saved to cache
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_dashboard-modified-1774778406285.jpeg> (referer: None)
2026-03-29 20:29:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.542(s), this was the 1st time calling it.
2026-03-29 20:29:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.224675934847292 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:29:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7167/20327167/instrument_cluster-1774719436219.jpeg> (referer: None)
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c271e10>
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_dashboard-modified-1774778406285.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_dashboard-modified-1774778406285.jpeg saved to cache
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:29:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:29:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;\xe1\x83\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\\\xa8\x00;\xd7\r\x00\x00\x00\x00'
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf6e10>
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7167%252F20327167%252Finstrument_cluster-1774719436219.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7167/20327167/instrument_cluster-1774719436219.jpeg saved to cache
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_rear_seats-modified-1774777214520.jpeg> (referer: None)
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f01d10>
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_rear_seats-modified-1774777214520.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_rear_seats-modified-1774777214520.jpeg saved to cache
2026-03-29 20:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_passenger-modified-1774777172498.jpeg> (referer: None)
2026-03-29 20:29:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_front_seats-modified-1774778418423.jpeg> (referer: None)
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba6350>
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-exterior_rear_passenger-modified-1774777172498.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_passenger-modified-1774777172498.jpeg saved to cache
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec77e90>
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-interior_front_seats-modified-1774778418423.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_front_seats-modified-1774778418423.jpeg saved to cache
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_front_passenger-modified-1774777105976.jpeg> (referer: None)
2026-03-29 20:29:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_driver-modified-1774778602682.jpeg> (referer: None)
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba75d0>
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-exterior_front_passenger-modified-1774777105976.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_front_passenger-modified-1774777105976.jpeg saved to cache
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edf78d0>
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7167%252F20327167%252F20327167-exterior_rear_driver-modified-1774778602682.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_driver-modified-1774778602682.jpeg saved to cache
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_driver-1774779579458.jpg> (referer: None)
2026-03-29 20:29:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7167/20327167/exterior_front_driver-1774719245843.jpeg> (referer: None)
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11a590>
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6248%252F20496248%252Fexterior_front_driver-1774779579458.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_driver-1774779579458.jpg saved to cache
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a1882f3-6311-5dee-a846-323295996ddf
2026-03-29 20:29:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a1882f3-6311-5dee-a846-323295996ddf, skipping ID generation
2026-03-29 20:29:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1882f3-6311-5dee-a846-323295996ddf with scrape type 1
2026-03-29 20:29:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a1882f3-6311-5dee-a846-323295996ddf sending to next pipeline
2026-03-29 20:29:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5a1882f3-6311-5dee-a846-323295996ddf, identifier: 20496248
2026-03-29 20:29:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5a1882f3-6311-5dee-a846-323295996ddf with identifier: 20496248
2026-03-29 20:29:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5a1882f3-6311-5dee-a846-323295996ddf with identifier: 20496248
2026-03-29 20:29:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5a1882f3-6311-5dee-a846-323295996ddf with identifier: 20496248 to the API
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_driver-1774779579458.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '5a1882f3-6311-5dee-a846-323295996ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YB20 BBF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20496248',
'listing': 'auction',
'location': 'East Riding of Yorkshire Cottingham',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 51380,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1749878,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_driver-1774779579458.jpg',
'Width': 3383},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1813502,
'Height': 2534,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_driver-1774779573110.jpg',
'Width': 3378},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1913376,
'Height': 2375,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_front_passenger-1774779585377.jpg',
'Width': 3166},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612875,
'Height': 2199,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6248/20496248/exterior_rear_passenger-1774779628871.jpg',
'Width': 2932},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1887621,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6248/20496248/interior_front_seats-1774780834088.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2279214,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6248/20496248/interior_rear_seats-1774780609347.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515713,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6248/20496248/interior_dashboard-1774782005850.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1047549,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6248/20496248/instrument_cluster-1774780534472.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1786595,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6248/20496248/interior_boot-1774780551391.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a1882f3-6311-5dee-a846-323295996ddf/5a1882f3-6311-5dee-a846-323295996ddf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607448,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6248/20496248/docs_service_history-1774780976740.jpg?ixlib=js-3.8.0&auto=format&s=97ac84aa56246855d708ef4cb86a5d23',
'Width': 3840}],
'price': 9613,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Y20 VVT-i HEV CVT',
'transmission': 'automatic',
'trim': 'Y20 VVT-i HEV CVT',
'vin': 'VNKKD3D380A671758',
'year': 2020}
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496248%27 HTTP/1.1" 200 None
2026-03-29 20:29:49 [motorway.uk] INFO: Saving data for 20496248: {'created_time': 1774816189.539372, 'last_price_update_time': 1774816189.539385, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20496248') HTTP/1.1" 204 0
2026-03-29 20:29:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf090>
2026-03-29 20:29:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7167%252F20327167%252Fexterior_front_driver-1774719245843.jpeg') HTTP/1.1" 204 0
2026-03-29 20:29:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7167/20327167/exterior_front_driver-1774719245843.jpeg saved to cache
2026-03-29 20:29:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1b6947a-a254-55cb-aacb-2404cde9271a
2026-03-29 20:29:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1b6947a-a254-55cb-aacb-2404cde9271a, skipping ID generation
2026-03-29 20:29:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b6947a-a254-55cb-aacb-2404cde9271a with scrape type 1
2026-03-29 20:29:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1b6947a-a254-55cb-aacb-2404cde9271a sending to next pipeline
2026-03-29 20:29:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d1b6947a-a254-55cb-aacb-2404cde9271a, identifier: 20327167
2026-03-29 20:29:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646762173.jpg?ixlib=js-3.8.0&auto=format&s=1a117edf31e58f3dcb514856a977ef90> (referer: None)
2026-03-29 20:29:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d1b6947a-a254-55cb-aacb-2404cde9271a with identifier: 20327167
2026-03-29 20:29:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d1b6947a-a254-55cb-aacb-2404cde9271a with identifier: 20327167
2026-03-29 20:29:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d1b6947a-a254-55cb-aacb-2404cde9271a with identifier: 20327167 to the API
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7167/20327167/exterior_front_driver-1774719245843.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd1b6947a-a254-55cb-aacb-2404cde9271a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG70 VXD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20327167',
'listing': 'auction',
'location': 'Greater Manchester Rochdale',
'make': 'BMW',
'model': '3 Series',
'odometer': 43872,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1746397,
'Height': 2784,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7167/20327167/exterior_front_driver-1774719245843.jpeg',
'Width': 3712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2215396,
'Height': 2624,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_driver-modified-1774778602682.jpeg',
'Width': 3499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2120927,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_front_passenger-modified-1774777105976.jpeg',
'Width': 3479},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1704748,
'Height': 2196,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-exterior_rear_passenger-modified-1774777172498.jpeg',
'Width': 2928},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2086495,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_front_seats-modified-1774778418423.jpeg',
'Width': 3854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1240590,
'Height': 2372,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_rear_seats-modified-1774777214520.jpeg',
'Width': 3163},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501297,
'Height': 2564,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_dashboard-modified-1774778406285.jpeg',
'Width': 3419},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4079147,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7167/20327167/instrument_cluster-1774719436219.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2035982,
'Height': 2599,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7167/20327167/20327167-interior_boot-modified-1774776635057.jpeg',
'Width': 3466},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b6947a-a254-55cb-aacb-2404cde9271a/d1b6947a-a254-55cb-aacb-2404cde9271a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 994097,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7167/20327167/docs_service_history-1774719134875.jpeg?ixlib=js-3.8.0&auto=format&s=204b441d311f4de9163eb4d547d39dfc',
'Width': 3024}],
'price': 18052,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seats_number': None,
'seller_name': None,
'title': 'BMW 320I M Sport Auto',
'transmission': 'automatic',
'trim': '320I M Sport Auto',
'vin': 'WBA5F320X0FJ69262',
'year': 2020}
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720327167%27 HTTP/1.1" 200 None
2026-03-29 20:29:50 [motorway.uk] INFO: Saving data for 20327167: {'created_time': 1774816190.107513, 'last_price_update_time': 1774816190.107523, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20327167') HTTP/1.1" 204 0
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec778d0>
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6554%252F20406554%252Fdocs_service_history-1774646762173.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1a117edf31e58f3dcb514856a977ef90') HTTP/1.1" 204 0
2026-03-29 20:29:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646762173.jpg?ixlib=js-3.8.0&auto=format&s=1a117edf31e58f3dcb514856a977ef90 saved to cache
2026-03-29 20:29:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6554/20406554/interior_boot-1774285629704.jpg> (referer: None)
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbea010>
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6554%252F20406554%252Finterior_boot-1774285629704.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6554/20406554/interior_boot-1774285629704.jpg saved to cache
2026-03-29 20:29:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6554/20406554/interior_dashboard-1774285965197.jpg> (referer: None)
2026-03-29 20:29:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6554/20406554/interior_rear_seats-1774285494879.jpg> (referer: None)
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba6110>
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Finterior_dashboard-1774285965197.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/interior_dashboard-1774285965197.jpg saved to cache
2026-03-29 20:29:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebef810>
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6554%252F20406554%252Finterior_rear_seats-1774285494879.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6554/20406554/interior_rear_seats-1774285494879.jpg saved to cache
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6554/20406554/interior_front_seats-1774285418914.jpg> (referer: None)
2026-03-29 20:29:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba49d0>
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6554%252F20406554%252Finterior_front_seats-1774285418914.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6554/20406554/interior_front_seats-1774285418914.jpg saved to cache
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_passenger-1774284540321.jpg> (referer: None)
2026-03-29 20:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_passenger-1774284567427.jpg> (referer: None)
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebeff90>
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_rear_passenger-1774284540321.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_passenger-1774284540321.jpg saved to cache
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc1528b7d0>
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_front_passenger-1774284567427.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_passenger-1774284567427.jpg saved to cache
2026-03-29 20:29:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_driver-1774284515291.jpg> (referer: None)
2026-03-29 20:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_driver-1774284494704.jpg> (referer: None)
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c649790>
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_rear_driver-1774284515291.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_driver-1774284515291.jpg saved to cache
2026-03-29 20:29:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadf0d0>
2026-03-29 20:29:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6554%252F20406554%252Fexterior_front_driver-1774284494704.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_driver-1774284494704.jpg saved to cache
2026-03-29 20:29:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1
2026-03-29 20:29:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2149c66f-a839-58bb-a6cc-ff519ed2d3e1, skipping ID generation
2026-03-29 20:29:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 with scrape type 1
2026-03-29 20:29:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 sending to next pipeline
2026-03-29 20:29:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2149c66f-a839-58bb-a6cc-ff519ed2d3e1, identifier: 20406554
2026-03-29 20:29:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 with identifier: 20406554
2026-03-29 20:29:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 with identifier: 20406554
2026-03-29 20:29:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2149c66f-a839-58bb-a6cc-ff519ed2d3e1 with identifier: 20406554 to the API
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_driver-1774284494704.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '2149c66f-a839-58bb-a6cc-ff519ed2d3e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YS66 JYW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20406554',
'listing': 'auction',
'location': 'South Yorkshire Doncaster',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 67400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1722595,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_driver-1774284494704.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1555099,
'Height': 2665,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_driver-1774284515291.jpg',
'Width': 3553},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1425378,
'Height': 2692,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_front_passenger-1774284567427.jpg',
'Width': 3589},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1781996,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6554/20406554/exterior_rear_passenger-1774284540321.jpg',
'Width': 3643},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3329619,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6554/20406554/interior_front_seats-1774285418914.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3505460,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6554/20406554/interior_rear_seats-1774285494879.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3345871,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6554/20406554/interior_dashboard-1774285965197.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3778832,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6554/20406554/interior_boot-1774285629704.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271771,
'Height': 2448,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646762173.jpg?ixlib=js-3.8.0&auto=format&s=1a117edf31e58f3dcb514856a977ef90',
'Width': 1320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2149c66f-a839-58bb-a6cc-ff519ed2d3e1/2149c66f-a839-58bb-a6cc-ff519ed2d3e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241117,
'Height': 2351,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6554/20406554/docs_service_history-1774646767439.jpg?ixlib=js-3.8.0&auto=format&s=8f695d038f70994118a05fc07529845c',
'Width': 1320}],
'price': 10593,
'price_includes_vat': False,
'registration_date': '2017-01-06',
'seats_number': None,
'seller_name': None,
'title': 'Toyota C-HR Dynamic HEV CVT',
'transmission': 'automatic',
'trim': 'Dynamic HEV CVT',
'vin': 'NMTKZ3BX00R011215',
'year': 2017}
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406554%27 HTTP/1.1" 200 None
2026-03-29 20:29:52 [motorway.uk] INFO: Saving data for 20406554: {'created_time': 1774816192.60268, 'last_price_update_time': 1774816192.602691, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20406554') HTTP/1.1" 204 0
2026-03-29 20:29:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20412314.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296c954f-0a25-548d-b279-51eac72f4f3a with identifier: 20412314
2026-03-29 20:29:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296c954f-0a25-548d-b279-51eac72f4f3a with scrape type 1
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2314%252F20412314%252Fexterior_front_driver-1774367014162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2314/20412314/exterior_front_driver-1774367014162.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Fexterior_rear_driver-1774618051152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_driver-1774618051152.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Fexterior_front_passenger-1774618066684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/exterior_front_passenger-1774618066684.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Fexterior_rear_passenger-1774618080300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_passenger-1774618080300.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2314%252F20412314%252Finterior_front_seats-1774367766623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2314/20412314/interior_front_seats-1774367766623.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2314%252F20412314%252Finterior_rear_seats-1774368247174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2314/20412314/interior_rear_seats-1774368247174.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Finterior_dashboard-1774618101641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/interior_dashboard-1774618101641.jpg not downloaded yet
2026-03-29 20:29:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2314%252F20412314%252Finstrument_cluster-1774617409394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2314/20412314/instrument_cluster-1774617409394.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Finterior_boot-1774618192770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/interior_boot-1774618192770.jpg not downloaded yet
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2314%252F20412314%252Fdocs_service_history-1774370233829.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D657cf7b457987fa9927744f5dbf74c01%27 HTTP/1.1" 200 None
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2314/20412314/docs_service_history-1774370233829.jpg?ixlib=js-3.8.0&auto=format&s=657cf7b457987fa9927744f5dbf74c01 not downloaded yet
2026-03-29 20:29:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_passenger-1774712951986.jpg> (referer: None)
2026-03-29 20:29:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976b90>
2026-03-29 20:29:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_front_passenger-1774712951986.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_passenger-1774712951986.jpg saved to cache
2026-03-29 20:29:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:29:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2314/20412314/docs_service_history-1774370233829.jpg?ixlib=js-3.8.0&auto=format&s=657cf7b457987fa9927744f5dbf74c01> (referer: None)
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:24 16:37:08\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A326B\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed70890>
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2314%252F20412314%252Fdocs_service_history-1774370233829.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D657cf7b457987fa9927744f5dbf74c01') HTTP/1.1" 204 0
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2314/20412314/docs_service_history-1774370233829.jpg?ixlib=js-3.8.0&auto=format&s=657cf7b457987fa9927744f5dbf74c01 saved to cache
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2314/20412314/interior_boot-1774618192770.jpg> (referer: None)
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d027c10>
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Finterior_boot-1774618192770.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/interior_boot-1774618192770.jpg saved to cache
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20235987.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c209c52-564e-5498-afdb-6380ddc631f7 with identifier: 20235987
2026-03-29 20:29:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c209c52-564e-5498-afdb-6380ddc631f7 with scrape type 1
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c209c52-564e-5498-afdb-6380ddc631f7
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5987%252F20235987%252Fexterior_front_driver-1774110280932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_front_driver-1774110280932.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5987%252F20235987%252Fexterior_rear_driver-1774110300251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_rear_driver-1774110300251.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5987%252F20235987%252Fexterior_front_passenger-1774110331880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_front_passenger-1774110331880.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5987%252F20235987%252Fexterior_rear_passenger-1774110317575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_rear_passenger-1774110317575.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5987%252F20235987%252Finterior_front_seats-1774110987762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5987/20235987/interior_front_seats-1774110987762.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5987%252F20235987%252Finterior_dashboard-1774111027340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5987/20235987/interior_dashboard-1774111027340.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5987%252F20235987%252Finstrument_cluster-1774110959999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5987/20235987/instrument_cluster-1774110959999.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5987%252F20235987%252Finterior_boot-1774110936435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5987/20235987/interior_boot-1774110936435.jpg already downloaded
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5987%252F20235987%252Fdocs_service_history-1774111337945.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da98c4711947c6c6e3ce1aee989edede9%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111337945.jpg?ixlib=js-3.8.0&auto=format&s=a98c4711947c6c6e3ce1aee989edede9 not downloaded yet
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5987%252F20235987%252Fdocs_service_history-1774111338581.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D567e9f5330d7164542c6753f88cea110%27 HTTP/1.1" 200 None
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111338581.jpg?ixlib=js-3.8.0&auto=format&s=567e9f5330d7164542c6753f88cea110 already downloaded
2026-03-29 20:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2314/20412314/interior_dashboard-1774618101641.jpg> (referer: None)
2026-03-29 20:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2314/20412314/instrument_cluster-1774617409394.jpg> (referer: None)
2026-03-29 20:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2314/20412314/interior_rear_seats-1774368247174.jpg> (referer: None)
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea66dd0>
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Finterior_dashboard-1774618101641.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/interior_dashboard-1774618101641.jpg saved to cache
2026-03-29 20:29:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:29:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.~`\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xdd\xaf\x00.WN\x00\x00\x00\x00'
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea65990>
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2314%252F20412314%252Finstrument_cluster-1774617409394.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2314/20412314/instrument_cluster-1774617409394.jpg saved to cache
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:24 15:52:17\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A326B\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07ca90>
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2314%252F20412314%252Finterior_rear_seats-1774368247174.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2314/20412314/interior_rear_seats-1774368247174.jpg saved to cache
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2314/20412314/interior_front_seats-1774367766623.jpg> (referer: None)
2026-03-29 20:29:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111337945.jpg?ixlib=js-3.8.0&auto=format&s=a98c4711947c6c6e3ce1aee989edede9> (referer: None)
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:24 15:56:02\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A326B\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:29:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c406390>
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2314%252F20412314%252Finterior_front_seats-1774367766623.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2314/20412314/interior_front_seats-1774367766623.jpg saved to cache
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ced4810>
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5987%252F20235987%252Fdocs_service_history-1774111337945.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da98c4711947c6c6e3ce1aee989edede9') HTTP/1.1" 204 0
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111337945.jpg?ixlib=js-3.8.0&auto=format&s=a98c4711947c6c6e3ce1aee989edede9 saved to cache
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c209c52-564e-5498-afdb-6380ddc631f7
2026-03-29 20:29:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c209c52-564e-5498-afdb-6380ddc631f7, skipping ID generation
2026-03-29 20:29:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c209c52-564e-5498-afdb-6380ddc631f7 with scrape type 1
2026-03-29 20:29:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c209c52-564e-5498-afdb-6380ddc631f7 sending to next pipeline
2026-03-29 20:29:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5c209c52-564e-5498-afdb-6380ddc631f7, identifier: 20235987
2026-03-29 20:29:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5c209c52-564e-5498-afdb-6380ddc631f7 with identifier: 20235987
2026-03-29 20:29:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5c209c52-564e-5498-afdb-6380ddc631f7 with identifier: 20235987
2026-03-29 20:29:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5c209c52-564e-5498-afdb-6380ddc631f7 with identifier: 20235987 to the API
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111337945.jpg?ixlib=js-3.8.0&auto=format&s=a98c4711947c6c6e3ce1aee989edede9>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5c209c52-564e-5498-afdb-6380ddc631f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VN66 ZHC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20235987',
'listing': 'auction',
'location': 'Mid And East Antrim Carrickfergus',
'make': 'Mazda',
'model': 'MX-5',
'odometer': 44000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458736,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_front_driver-1774110280932.jpg',
'Width': 3299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825439,
'Height': 2642,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_rear_driver-1774110300251.jpg',
'Width': 3523},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539167,
'Height': 2255,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_front_passenger-1774110331880.jpg',
'Width': 3006},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1863056,
'Height': 2333,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5987/20235987/exterior_rear_passenger-1774110317575.jpg',
'Width': 3111},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3815772,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5987/20235987/interior_front_seats-1774110987762.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1731567,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5987/20235987/interior_dashboard-1774111027340.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342323,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5987/20235987/instrument_cluster-1774110959999.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3953216,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5987/20235987/interior_boot-1774110936435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1047422,
'Height': 3469,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111337945.jpg?ixlib=js-3.8.0&auto=format&s=a98c4711947c6c6e3ce1aee989edede9',
'Width': 2514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c209c52-564e-5498-afdb-6380ddc631f7/5c209c52-564e-5498-afdb-6380ddc631f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2998059,
'Height': 3320,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5987/20235987/docs_service_history-1774111338581.jpg?ixlib=js-3.8.0&auto=format&s=567e9f5330d7164542c6753f88cea110',
'Width': 2295}],
'price': 10500,
'price_includes_vat': False,
'registration_date': '2017-01-17',
'seats_number': None,
'seller_name': None,
'title': 'Mazda MX-5 RF Sport NAV',
'transmission': 'manual',
'trim': 'RF Sport NAV',
'vin': 'JMZND6E7600124270',
'year': 2017}
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235987%27 HTTP/1.1" 200 None
2026-03-29 20:29:55 [motorway.uk] INFO: Saving data for 20235987: {'created_time': 1774816195.826839, 'last_price_update_time': 1774816195.826849, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20235987') HTTP/1.1" 204 0
2026-03-29 20:29:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_passenger-1774618080300.jpg> (referer: None)
2026-03-29 20:29:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2314/20412314/exterior_front_passenger-1774618066684.jpg> (referer: None)
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c407b50>
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Fexterior_rear_passenger-1774618080300.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_passenger-1774618080300.jpg saved to cache
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec83c50>
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Fexterior_front_passenger-1774618066684.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/exterior_front_passenger-1774618066684.jpg saved to cache
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2314/20412314/exterior_front_driver-1774367014162.jpg> (referer: None)
2026-03-29 20:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_driver-1774618051152.jpg> (referer: None)
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ec650>
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2314%252F20412314%252Fexterior_front_driver-1774367014162.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2314/20412314/exterior_front_driver-1774367014162.jpg saved to cache
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea66950>
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2314%252F20412314%252Fexterior_rear_driver-1774618051152.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_driver-1774618051152.jpg saved to cache
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 296c954f-0a25-548d-b279-51eac72f4f3a
2026-03-29 20:29:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 296c954f-0a25-548d-b279-51eac72f4f3a, skipping ID generation
2026-03-29 20:29:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296c954f-0a25-548d-b279-51eac72f4f3a with scrape type 1
2026-03-29 20:29:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 296c954f-0a25-548d-b279-51eac72f4f3a sending to next pipeline
2026-03-29 20:29:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 296c954f-0a25-548d-b279-51eac72f4f3a, identifier: 20412314
2026-03-29 20:29:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 296c954f-0a25-548d-b279-51eac72f4f3a with identifier: 20412314
2026-03-29 20:29:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 296c954f-0a25-548d-b279-51eac72f4f3a with identifier: 20412314
2026-03-29 20:29:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 296c954f-0a25-548d-b279-51eac72f4f3a with identifier: 20412314 to the API
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_driver-1774618051152.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '296c954f-0a25-548d-b279-51eac72f4f3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD71 EHN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20412314',
'listing': 'auction',
'location': 'West Midlands Sutton Coldfield',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 57445,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252182,
'Height': 926,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2314/20412314/exterior_front_driver-1774367014162.jpg',
'Width': 1234},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387740,
'Height': 1076,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_driver-1774618051152.jpg',
'Width': 1435},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 445332,
'Height': 1001,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2314/20412314/exterior_front_passenger-1774618066684.jpg',
'Width': 1334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361497,
'Height': 1058,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2314/20412314/exterior_rear_passenger-1774618080300.jpg',
'Width': 1411},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581761,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/2314/20412314/interior_front_seats-1774367766623.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630480,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/2314/20412314/interior_rear_seats-1774368247174.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250360,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2314/20412314/interior_dashboard-1774618101641.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3365903,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2314/20412314/instrument_cluster-1774617409394.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261136,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2314/20412314/interior_boot-1774618192770.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296c954f-0a25-548d-b279-51eac72f4f3a/296c954f-0a25-548d-b279-51eac72f4f3a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607994,
'Height': 1080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2314/20412314/docs_service_history-1774370233829.jpg?ixlib=js-3.8.0&auto=format&s=657cf7b457987fa9927744f5dbf74c01',
'Width': 1440}],
'price': 14551,
'price_includes_vat': False,
'registration_date': '2022-02-11',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 250 AMG Line Edition E Auto',
'transmission': 'automatic',
'trim': 'A 250 AMG Line Edition E Auto',
'vin': 'W1K1771862J347045',
'year': 2022}
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720412314%27 HTTP/1.1" 200 None
2026-03-29 20:29:56 [motorway.uk] INFO: Saving data for 20412314: {'created_time': 1774816196.816711, 'last_price_update_time': 1774816196.816723, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20412314') HTTP/1.1" 204 0
2026-03-29 20:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_driver-1774712952336.jpg> (referer: None)
2026-03-29 20:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_rear_driver-1774712951918.jpg> (referer: None)
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d119490>
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_front_driver-1774712952336.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_driver-1774712952336.jpg saved to cache
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d07df90>
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7515%252F20307515%252Fexterior_rear_driver-1774712951918.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_rear_driver-1774712951918.jpg saved to cache
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c646be4a-0c13-5855-8f44-ec0f6774942e
2026-03-29 20:29:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c646be4a-0c13-5855-8f44-ec0f6774942e, skipping ID generation
2026-03-29 20:29:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c646be4a-0c13-5855-8f44-ec0f6774942e with scrape type 1
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c646be4a-0c13-5855-8f44-ec0f6774942e sending to next pipeline
2026-03-29 20:29:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c646be4a-0c13-5855-8f44-ec0f6774942e, identifier: 20307515
2026-03-29 20:29:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c646be4a-0c13-5855-8f44-ec0f6774942e with identifier: 20307515
2026-03-29 20:29:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c646be4a-0c13-5855-8f44-ec0f6774942e with identifier: 20307515
2026-03-29 20:29:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c646be4a-0c13-5855-8f44-ec0f6774942e with identifier: 20307515 to the API
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_rear_driver-1774712951918.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c646be4a-0c13-5855-8f44-ec0f6774942e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM21 YTW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20307515',
'listing': 'auction',
'location': 'Greater London Ilford',
'make': 'Fiat',
'model': '500',
'odometer': 57034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1143308,
'Height': 2412,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_driver-1774712952336.jpg',
'Width': 3216},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211499,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_rear_driver-1774712951918.jpg',
'Width': 3219},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1315092,
'Height': 2407,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7515/20307515/exterior_front_passenger-1774712951986.jpg',
'Width': 3209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2540469,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7515/20307515/interior_front_seats-1774713527032.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3287703,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7515/20307515/interior_rear_seats-1774713526363.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1783402,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7515/20307515/interior_dashboard-1774714991505.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2471884,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7515/20307515/interior_boot-1774713525248.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1861906,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7515/20307515/damage_scratches-1774713027843.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c646be4a-0c13-5855-8f44-ec0f6774942e/c646be4a-0c13-5855-8f44-ec0f6774942e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1186737,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7515/20307515/damage_warning_lights-1774714382660.jpg',
'Width': 3840}],
'price': 5816,
'price_includes_vat': False,
'registration_date': '2021-06-24',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge MHEV',
'transmission': 'manual',
'trim': 'Lounge MHEV',
'vin': 'ZFA3120000JE94780',
'year': 2021}
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720307515%27 HTTP/1.1" 200 None
2026-03-29 20:29:57 [motorway.uk] INFO: Saving data for 20307515: {'created_time': 1774816197.674934, 'last_price_update_time': 1774816197.674945, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20307515') HTTP/1.1" 204 0
2026-03-29 20:29:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1960/20481960/interior_rear_seats-1774691911208.jpg> (referer: None)
2026-03-29 20:29:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1960/20481960/interior_front_seats-1774691884732.jpg> (referer: None)
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b0790>
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1960%252F20481960%252Finterior_rear_seats-1774691911208.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1960/20481960/interior_rear_seats-1774691911208.jpg saved to cache
2026-03-29 20:29:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:29:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20377393.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20420305.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:29:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce4b6d0>
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1960%252F20481960%252Finterior_front_seats-1774691884732.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1960/20481960/interior_front_seats-1774691884732.jpg saved to cache
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:29:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c61e9ba8-9f48-5845-bb18-c9ec37a5551a with identifier: 20377393
2026-03-29 20:29:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a with scrape type 1
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_front_driver-1774115170471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_driver-1774115170471.jpg not downloaded yet
2026-03-29 20:29:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf982a0-e4d4-5736-901e-f60094668b0a with identifier: 20420305
2026-03-29 20:29:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf982a0-e4d4-5736-901e-f60094668b0a with scrape type 1
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_front_driver-1774705081446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_driver-1774705081446.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_rear_driver-1774115178370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_driver-1774115178370.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_rear_driver-1774705139914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_driver-1774705139914.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_front_passenger-1774115176456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_passenger-1774115176456.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_front_passenger-1774705055979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_passenger-1774705055979.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_rear_passenger-1774115174071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_passenger-1774115174071.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_rear_passenger-1774705109186.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_passenger-1774705109186.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7393%252F20377393%252Finterior_front_seats-1774705012182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7393/20377393/interior_front_seats-1774705012182.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0305%252F20420305%252Finterior_front_seats-1774705557548.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0305/20420305/interior_front_seats-1774705557548.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7393%252F20377393%252Finterior_rear_seats-1774704943244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7393/20377393/interior_rear_seats-1774704943244.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0305%252F20420305%252Finterior_rear_seats-1774705585055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0305/20420305/interior_rear_seats-1774705585055.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Finterior_dashboard-1774704954688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/interior_dashboard-1774704954688.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0305%252F20420305%252Finterior_dashboard-1774716767917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0305/20420305/interior_dashboard-1774716767917.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Finstrument_cluster-1774704934588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/instrument_cluster-1774704934588.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Finstrument_cluster-1774705540258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/instrument_cluster-1774705540258.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7393%252F20377393%252Finterior_boot-1774704945818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7393/20377393/interior_boot-1774704945818.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0305%252F20420305%252Finterior_boot-1774705652333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0305/20420305/interior_boot-1774705652333.jpg not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F7393%252F20377393%252Fdocs_service_history-1774705719063.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6b5eddad6ac5654dab2f279f49cbfecb%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/7393/20377393/docs_service_history-1774705719063.jpg?ixlib=js-3.8.0&auto=format&s=6b5eddad6ac5654dab2f279f49cbfecb not downloaded yet
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0305%252F20420305%252Fdocs_service_history-1774706003935.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D619b55d635eb46bd52dd79e13ff2b760%27 HTTP/1.1" 200 None
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0305/20420305/docs_service_history-1774706003935.jpg?ixlib=js-3.8.0&auto=format&s=619b55d635eb46bd52dd79e13ff2b760 not downloaded yet
2026-03-29 20:29:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_passenger-1774691484577.jpg> (referer: None)
2026-03-29 20:29:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9715/20249715/instrument_cluster-1774435051668.jpg> (referer: None)
2026-03-29 20:29:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_passenger-1774691502427.jpg> (referer: None)
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e2590>
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_rear_passenger-1774691484577.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_passenger-1774691484577.jpg saved to cache
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8ebd0>
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Finstrument_cluster-1774435051668.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/instrument_cluster-1774435051668.jpg saved to cache
2026-03-29 20:29:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15c650>
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1960%252F20481960%252Fexterior_front_passenger-1774691502427.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_passenger-1774691502427.jpg saved to cache
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6
2026-03-29 20:29:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6, skipping ID generation
2026-03-29 20:29:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 with scrape type 1
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 sending to next pipeline
2026-03-29 20:29:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6, identifier: 20481960
2026-03-29 20:29:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 with identifier: 20481960
2026-03-29 20:29:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 with identifier: 20481960
2026-03-29 20:29:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 21a3a7d5-f2d0-565a-b08c-40956f2f2bb6 with identifier: 20481960 to the API
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:29:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_passenger-1774691502427.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '21a3a7d5-f2d0-565a-b08c-40956f2f2bb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HX23 ZPZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20481960',
'listing': 'auction',
'location': 'Surrey Guildford',
'make': 'MG',
'model': 'HS',
'odometer': 35705,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1564340,
'Height': 2611,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_driver-1774691439395.jpg',
'Width': 3481},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1876781,
'Height': 2693,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_driver-1774691461363.jpg',
'Width': 3591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616883,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_front_passenger-1774691502427.jpg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1462073,
'Height': 2611,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1960/20481960/exterior_rear_passenger-1774691484577.jpg',
'Width': 3481},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3030659,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1960/20481960/interior_front_seats-1774691884732.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443825,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1960/20481960/interior_rear_seats-1774691911208.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1636422,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1960/20481960/interior_dashboard-1774691947110.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2212681,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1960/20481960/interior_boot-1774691948621.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24296,
'Height': 418,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1960/20481960/damage_scratches-1774693261852.jpg',
'Width': 558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3a7d5-f2d0-565a-b08c-40956f2f2bb6/21a3a7d5-f2d0-565a-b08c-40956f2f2bb6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24258,
'Height': 371,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1960/20481960/damage_dents-1774693163280.jpg',
'Width': 494}],
'price': 10123,
'price_includes_vat': False,
'registration_date': '2023-03-21',
'seats_number': None,
'seller_name': None,
'title': 'MG HS Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'vin': 'LSJA24U92NN206671',
'year': 2023}
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481960%27 HTTP/1.1" 200 None
2026-03-29 20:29:59 [motorway.uk] INFO: Saving data for 20481960: {'created_time': 1774816199.489661, 'last_price_update_time': 1774816199.489673, 'auction_closing_time': 1774884600.0}
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20481960') HTTP/1.1" 204 0
2026-03-29 20:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0305/20420305/docs_service_history-1774706003935.jpg?ixlib=js-3.8.0&auto=format&s=619b55d635eb46bd52dd79e13ff2b760> (referer: None)
2026-03-29 20:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/7393/20377393/docs_service_history-1774705719063.jpg?ixlib=js-3.8.0&auto=format&s=6b5eddad6ac5654dab2f279f49cbfecb> (referer: None)
2026-03-29 20:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0305/20420305/interior_boot-1774705652333.jpg> (referer: None)
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03b990>
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0305%252F20420305%252Fdocs_service_history-1774706003935.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D619b55d635eb46bd52dd79e13ff2b760') HTTP/1.1" 204 0
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0305/20420305/docs_service_history-1774706003935.jpg?ixlib=js-3.8.0&auto=format&s=619b55d635eb46bd52dd79e13ff2b760 saved to cache
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:29:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.719(s), this was the 1st time calling it.
2026-03-29 20:29:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.500596838838689 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t\x0c'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecf050>
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F7393%252F20377393%252Fdocs_service_history-1774705719063.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6b5eddad6ac5654dab2f279f49cbfecb') HTTP/1.1" 204 0
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/7393/20377393/docs_service_history-1774705719063.jpg?ixlib=js-3.8.0&auto=format&s=6b5eddad6ac5654dab2f279f49cbfecb saved to cache
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:29:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071690>
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:29:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:29:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0305%252F20420305%252Finterior_boot-1774705652333.jpg') HTTP/1.1" 204 0
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0305/20420305/interior_boot-1774705652333.jpg saved to cache
2026-03-29 20:29:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0305/20420305/instrument_cluster-1774705540258.jpg> (referer: None)
2026-03-29 20:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7393/20377393/interior_boot-1774704945818.jpg> (referer: None)
2026-03-29 20:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7393/20377393/instrument_cluster-1774704934588.jpg> (referer: None)
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15c690>
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Finstrument_cluster-1774705540258.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/instrument_cluster-1774705540258.jpg saved to cache
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec80510>
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7393%252F20377393%252Finterior_boot-1774704945818.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7393/20377393/interior_boot-1774704945818.jpg saved to cache
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecfa10>
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Finstrument_cluster-1774704934588.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/instrument_cluster-1774704934588.jpg saved to cache
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0305/20420305/interior_dashboard-1774716767917.jpg> (referer: None)
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95fe10>
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0305%252F20420305%252Finterior_dashboard-1774716767917.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0305/20420305/interior_dashboard-1774716767917.jpg saved to cache
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7393/20377393/interior_rear_seats-1774704943244.jpg> (referer: None)
2026-03-29 20:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0305/20420305/interior_rear_seats-1774705585055.jpg> (referer: None)
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e2a10>
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7393%252F20377393%252Finterior_rear_seats-1774704943244.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7393/20377393/interior_rear_seats-1774704943244.jpg saved to cache
2026-03-29 20:30:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa5ed0>
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0305%252F20420305%252Finterior_rear_seats-1774705585055.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0305/20420305/interior_rear_seats-1774705585055.jpg saved to cache
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7393/20377393/interior_dashboard-1774704954688.jpg> (referer: None)
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0305/20420305/interior_front_seats-1774705557548.jpg> (referer: None)
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95de10>
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Finterior_dashboard-1774704954688.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/interior_dashboard-1774704954688.jpg saved to cache
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa4110>
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0305%252F20420305%252Finterior_front_seats-1774705557548.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0305/20420305/interior_front_seats-1774705557548.jpg saved to cache
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_passenger-1774705109186.jpg> (referer: None)
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7393/20377393/interior_front_seats-1774705012182.jpg> (referer: None)
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95c910>
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_rear_passenger-1774705109186.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_passenger-1774705109186.jpg saved to cache
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03b6d0>
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7393%252F20377393%252Finterior_front_seats-1774705012182.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7393/20377393/interior_front_seats-1774705012182.jpg saved to cache
2026-03-29 20:30:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_passenger-1774705055979.jpg> (referer: None)
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_passenger-1774115176456.jpg> (referer: None)
2026-03-29 20:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_passenger-1774115174071.jpg> (referer: None)
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e996990>
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_front_passenger-1774705055979.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_passenger-1774705055979.jpg saved to cache
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7e0950>
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_front_passenger-1774115176456.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_passenger-1774115176456.jpg saved to cache
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e073890>
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_rear_passenger-1774115174071.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_passenger-1774115174071.jpg saved to cache
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_driver-1774705081446.jpg> (referer: None)
2026-03-29 20:30:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_driver-1774705139914.jpg> (referer: None)
2026-03-29 20:30:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_driver-1774115178370.jpg> (referer: None)
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e949e10>
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_front_driver-1774705081446.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_driver-1774705081446.jpg saved to cache
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecc250>
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0305%252F20420305%252Fexterior_rear_driver-1774705139914.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_driver-1774705139914.jpg saved to cache
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcf982a0-e4d4-5736-901e-f60094668b0a
2026-03-29 20:30:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcf982a0-e4d4-5736-901e-f60094668b0a, skipping ID generation
2026-03-29 20:30:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf982a0-e4d4-5736-901e-f60094668b0a with scrape type 1
2026-03-29 20:30:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcf982a0-e4d4-5736-901e-f60094668b0a sending to next pipeline
2026-03-29 20:30:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fcf982a0-e4d4-5736-901e-f60094668b0a, identifier: 20420305
2026-03-29 20:30:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fcf982a0-e4d4-5736-901e-f60094668b0a with identifier: 20420305
2026-03-29 20:30:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fcf982a0-e4d4-5736-901e-f60094668b0a with identifier: 20420305
2026-03-29 20:30:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fcf982a0-e4d4-5736-901e-f60094668b0a with identifier: 20420305 to the API
2026-03-29 20:30:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_driver-1774705139914.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fcf982a0-e4d4-5736-901e-f60094668b0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CN72 XUX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20420305',
'listing': 'auction',
'location': 'Surrey Addlestone',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 9000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 860766,
'Height': 1794,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_driver-1774705081446.jpg',
'Width': 2392},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2099096,
'Height': 2671,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_driver-1774705139914.jpg',
'Width': 3561},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102535,
'Height': 2789,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_front_passenger-1774705055979.jpg',
'Width': 3719},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2231101,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0305/20420305/exterior_rear_passenger-1774705109186.jpg',
'Width': 3790},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2707200,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0305/20420305/interior_front_seats-1774705557548.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4481242,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0305/20420305/interior_rear_seats-1774705585055.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2737328,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0305/20420305/interior_dashboard-1774716767917.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2583512,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0305/20420305/instrument_cluster-1774705540258.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2780132,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0305/20420305/interior_boot-1774705652333.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf982a0-e4d4-5736-901e-f60094668b0a/fcf982a0-e4d4-5736-901e-f60094668b0a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586066,
'Height': 3098,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0305/20420305/docs_service_history-1774706003935.jpg?ixlib=js-3.8.0&auto=format&s=619b55d635eb46bd52dd79e13ff2b760',
'Width': 2237}],
'price': 19588,
'price_includes_vat': False,
'registration_date': '2022-12-02',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 AMG Line Premium Auto',
'transmission': 'automatic',
'trim': 'A 180 AMG Line Premium Auto',
'vin': 'W1K3F8EB6PV161623',
'year': 2022}
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420305%27 HTTP/1.1" 200 None
2026-03-29 20:30:03 [motorway.uk] INFO: Saving data for 20420305: {'created_time': 1774816203.661911, 'last_price_update_time': 1774816203.661923, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20420305') HTTP/1.1" 204 0
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4a550>
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_rear_driver-1774115178370.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_driver-1774115178370.jpg saved to cache
2026-03-29 20:30:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.067(s), this was the 2nd time calling it.
2026-03-29 20:30:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.374873335743382 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:30:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_driver-1774115170471.jpg> (referer: None)
2026-03-29 20:30:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9715/20249715/interior_dashboard-1774435010537.jpg> (referer: None)
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95c290>
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7393%252F20377393%252Fexterior_front_driver-1774115170471.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_driver-1774115170471.jpg saved to cache
2026-03-29 20:30:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a
2026-03-29 20:30:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c61e9ba8-9f48-5845-bb18-c9ec37a5551a, skipping ID generation
2026-03-29 20:30:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a with scrape type 1
2026-03-29 20:30:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c61e9ba8-9f48-5845-bb18-c9ec37a5551a sending to next pipeline
2026-03-29 20:30:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c61e9ba8-9f48-5845-bb18-c9ec37a5551a, identifier: 20377393
2026-03-29 20:30:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c61e9ba8-9f48-5845-bb18-c9ec37a5551a with identifier: 20377393
2026-03-29 20:30:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c61e9ba8-9f48-5845-bb18-c9ec37a5551a with identifier: 20377393
2026-03-29 20:30:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c61e9ba8-9f48-5845-bb18-c9ec37a5551a with identifier: 20377393 to the API
2026-03-29 20:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_driver-1774115170471.jpg>
{'auction_title': '',
'category': None,
'color': 'Gold',
'currency': 'GBP',
'doors_number': None,
'engine': '4.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c61e9ba8-9f48-5845-bb18-c9ec37a5551a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OE13 YOP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20377393',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 170577,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1116998,
'Height': 2029,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_driver-1774115170471.jpg',
'Width': 2705},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 990808,
'Height': 1850,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_driver-1774115178370.jpg',
'Width': 2467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1157150,
'Height': 2017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_front_passenger-1774115176456.jpg',
'Width': 2689},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1472123,
'Height': 2162,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7393/20377393/exterior_rear_passenger-1774115174071.jpg',
'Width': 2883},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546303,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7393/20377393/interior_front_seats-1774705012182.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571097,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7393/20377393/interior_rear_seats-1774704943244.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2926876,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7393/20377393/interior_dashboard-1774704954688.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1935620,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7393/20377393/instrument_cluster-1774704934588.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3094641,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7393/20377393/interior_boot-1774704945818.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61e9ba8-9f48-5845-bb18-c9ec37a5551a/c61e9ba8-9f48-5845-bb18-c9ec37a5551a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1017791,
'Height': 2316,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/7393/20377393/docs_service_history-1774705719063.jpg?ixlib=js-3.8.0&auto=format&s=6b5eddad6ac5654dab2f279f49cbfecb',
'Width': 1080}],
'price': 9082,
'price_includes_vat': False,
'registration_date': '2013-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover AUTO-B SDV8 A',
'transmission': 'automatic',
'trim': 'AUTO-B SDV8 A',
'vin': 'SALGA2JEXDA122634',
'year': 2013}
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720377393%27 HTTP/1.1" 200 None
2026-03-29 20:30:05 [motorway.uk] INFO: Saving data for 20377393: {'created_time': 1774816205.906826, 'last_price_update_time': 1774816205.906839, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20377393') HTTP/1.1" 204 0
2026-03-29 20:30:05 [scrapy.extensions.logstats] INFO: Crawled 296 pages (at 13 pages/min), scraped 257 items (at 21 items/min)
2026-03-29 20:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:30:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:30:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3fa750>
2026-03-29 20:30:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Finterior_dashboard-1774435010537.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/interior_dashboard-1774435010537.jpg saved to cache
2026-03-29 20:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:30:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9715/20249715/interior_rear_seats-1774435069977.jpg> (referer: None)
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07fb50>
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9715%252F20249715%252Finterior_rear_seats-1774435069977.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9715/20249715/interior_rear_seats-1774435069977.jpg saved to cache
2026-03-29 20:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:30:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6587/19346587/docs_service_history-1774787752464.jpg?ixlib=js-3.8.0&auto=format&s=41e3bd8d180e80333f77291ddeff75af> (referer: None)
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3fa650>
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6587%252F19346587%252Fdocs_service_history-1774787752464.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41e3bd8d180e80333f77291ddeff75af') HTTP/1.1" 204 0
2026-03-29 20:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6587/19346587/docs_service_history-1774787752464.jpg?ixlib=js-3.8.0&auto=format&s=41e3bd8d180e80333f77291ddeff75af saved to cache
2026-03-29 20:30:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19584822.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab48d8e8-646f-50f6-b6f4-085a502431ea with identifier: 19584822
2026-03-29 20:30:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab48d8e8-646f-50f6-b6f4-085a502431ea with scrape type 1
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_front_driver-1774634073166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_driver-1774634073166.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_rear_driver-1774634085483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_driver-1774634085483.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_front_passenger-1774634055767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_passenger-1774634055767.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_rear_passenger-1774634036836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_passenger-1774634036836.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Finterior_front_seats-1774634782071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/interior_front_seats-1774634782071.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Finterior_rear_seats-1774634799050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/interior_rear_seats-1774634799050.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Finterior_dashboard-1774634864540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/interior_dashboard-1774634864540.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Finstrument_cluster-1774634880508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/instrument_cluster-1774634880508.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Finterior_boot-1774634850420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/interior_boot-1774634850420.jpg not downloaded yet
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Fdamage_scratches-1774634169430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/damage_scratches-1774634169430.jpg not downloaded yet
2026-03-29 20:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9715/20249715/interior_front_seats-1774435006837.jpg> (referer: None)
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0a07d0>
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9715%252F20249715%252Finterior_front_seats-1774435006837.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9715/20249715/interior_front_seats-1774435006837.jpg saved to cache
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4822/19584822/damage_scratches-1774634169430.jpg> (referer: None)
2026-03-29 20:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13570427.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12d490>
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Fdamage_scratches-1774634169430.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/damage_scratches-1774634169430.jpg saved to cache
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e8c69ff-15ae-5862-90f5-9a3bc8af491e with identifier: 13570427
2026-03-29 20:30:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e with scrape type 1
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_front_driver-1774710977260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_driver-1774710977260.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_rear_driver-1774710991895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_driver-1774710991895.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_front_passenger-1774711013047.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_passenger-1774711013047.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_rear_passenger-1774711813118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_passenger-1774711813118.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0427%252F13570427%252Finterior_front_seats-1774711294454.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0427/13570427/interior_front_seats-1774711294454.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0427%252F13570427%252Finterior_rear_seats-1774711316780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0427/13570427/interior_rear_seats-1774711316780.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Finterior_dashboard-1774711338400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/interior_dashboard-1774711338400.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0427%252F13570427%252Finstrument_cluster-1774714731104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0427/13570427/instrument_cluster-1774714731104.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0427%252F13570427%252Finterior_boot-1774711348641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0427/13570427/interior_boot-1774711348641.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0427%252F13570427%252Fdocs_service_history-1774715231533.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da7e0c4f9454a35d38955efbd6392185a%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0427/13570427/docs_service_history-1774715231533.jpg?ixlib=js-3.8.0&auto=format&s=a7e0c4f9454a35d38955efbd6392185a not downloaded yet
2026-03-29 20:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484591.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4822/19584822/instrument_cluster-1774634880508.jpg> (referer: None)
2026-03-29 20:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4822/19584822/interior_boot-1774634850420.jpg> (referer: None)
2026-03-29 20:30:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce00621-6614-5cf0-bd96-7f64cffb8cb6 with identifier: 20484591
2026-03-29 20:30:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce00621-6614-5cf0-bd96-7f64cffb8cb6 with scrape type 1
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4591%252F20484591%252Fexterior_front_driver-1774771792009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4591/20484591/exterior_front_driver-1774771792009.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Fexterior_rear_driver-1774724007420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_rear_driver-1774724007420.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Fexterior_front_passenger-1774724046862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_front_passenger-1774724046862.jpg not downloaded yet
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976250>
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Finstrument_cluster-1774634880508.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/instrument_cluster-1774634880508.jpg saved to cache
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2e0d0>
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Finterior_boot-1774634850420.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/interior_boot-1774634850420.jpg saved to cache
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4591%252F20484591%252Fexterior_rear_passenger-1774771533691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4591/20484591/exterior_rear_passenger-1774771533691.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4591%252F20484591%252Finterior_front_seats-1774771629383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4591/20484591/interior_front_seats-1774771629383.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4591%252F20484591%252Finterior_rear_seats-1774724571335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4591/20484591/interior_rear_seats-1774724571335.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Finterior_dashboard-1774724662631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/interior_dashboard-1774724662631.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Finstrument_cluster-1774724575359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/instrument_cluster-1774724575359.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4591%252F20484591%252Finterior_boot-1774724547255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4591/20484591/interior_boot-1774724547255.jpg not downloaded yet
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4591%252F20484591%252Fdocs_service_history-1774724976515.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da98f3582575e9097e42d68fc8e6f621d%27 HTTP/1.1" 200 None
2026-03-29 20:30:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4591/20484591/docs_service_history-1774724976515.jpg?ixlib=js-3.8.0&auto=format&s=a98f3582575e9097e42d68fc8e6f621d not downloaded yet
2026-03-29 20:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0427/13570427/docs_service_history-1774715231533.jpg?ixlib=js-3.8.0&auto=format&s=a7e0c4f9454a35d38955efbd6392185a> (referer: None)
2026-03-29 20:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0427/13570427/interior_boot-1774711348641.jpg> (referer: None)
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec890d0>
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0427%252F13570427%252Fdocs_service_history-1774715231533.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da7e0c4f9454a35d38955efbd6392185a') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0427/13570427/docs_service_history-1774715231533.jpg?ixlib=js-3.8.0&auto=format&s=a7e0c4f9454a35d38955efbd6392185a saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d02e050>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0427%252F13570427%252Finterior_boot-1774711348641.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0427/13570427/interior_boot-1774711348641.jpg saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4591/20484591/docs_service_history-1774724976515.jpg?ixlib=js-3.8.0&auto=format&s=a98f3582575e9097e42d68fc8e6f621d> (referer: None)
2026-03-29 20:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4591/20484591/exterior_rear_passenger-1774771533691.jpg> (referer: None)
2026-03-29 20:30:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 20:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4591/20484591/interior_boot-1774724547255.jpg> (referer: None)
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d08d710>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4591%252F20484591%252Fdocs_service_history-1774724976515.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da98f3582575e9097e42d68fc8e6f621d') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4591/20484591/docs_service_history-1774724976515.jpg?ixlib=js-3.8.0&auto=format&s=a98f3582575e9097e42d68fc8e6f621d saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce64650>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4591%252F20484591%252Fexterior_rear_passenger-1774771533691.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4591/20484591/exterior_rear_passenger-1774771533691.jpg saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed9a750>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4591%252F20484591%252Finterior_boot-1774724547255.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4591/20484591/interior_boot-1774724547255.jpg saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4591/20484591/instrument_cluster-1774724575359.jpg> (referer: None)
2026-03-29 20:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4591/20484591/interior_rear_seats-1774724571335.jpg> (referer: None)
2026-03-29 20:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4591/20484591/interior_dashboard-1774724662631.jpg> (referer: None)
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d289650>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Finstrument_cluster-1774724575359.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/instrument_cluster-1774724575359.jpg saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed98a10>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4591%252F20484591%252Finterior_rear_seats-1774724571335.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4591/20484591/interior_rear_seats-1774724571335.jpg saved to cache
2026-03-29 20:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed9ab10>
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Finterior_dashboard-1774724662631.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/interior_dashboard-1774724662631.jpg saved to cache
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18114762.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_front_passenger-1774724046862.jpg> (referer: None)
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4591/20484591/interior_front_seats-1774771629383.jpg> (referer: None)
2026-03-29 20:30:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02db23df-d2db-5085-b004-c9fc5aeaa3e1 with identifier: 18114762
2026-03-29 20:30:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1 with scrape type 1
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_front_driver-1773138519371.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_driver-1773138519371.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_rear_driver-1773138565981.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_driver-1773138565981.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_front_passenger-1773138542222.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_passenger-1773138542222.jpeg not downloaded yet
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d026290>
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Fexterior_front_passenger-1774724046862.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_front_passenger-1774724046862.jpg saved to cache
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_rear_passenger-1773138556431.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_passenger-1773138556431.jpeg not downloaded yet
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d33de90>
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4591%252F20484591%252Finterior_front_seats-1774771629383.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4591/20484591/interior_front_seats-1774771629383.jpg saved to cache
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4762%252F18114762%252Finterior_front_seats-1773138856353.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4762/18114762/interior_front_seats-1773138856353.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4762%252F18114762%252Finterior_rear_seats-1773138918806.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4762/18114762/interior_rear_seats-1773138918806.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4762%252F18114762%252F18114762-interior_dashboard-modified-1774707125111.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4762/18114762/18114762-interior_dashboard-modified-1774707125111.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4762%252F18114762%252F18114762-instrument_cluster-modified-1774776534624.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4762/18114762/18114762-instrument_cluster-modified-1774776534624.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4762%252F18114762%252Finterior_boot-1773138989082.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4762/18114762/interior_boot-1773138989082.jpeg not downloaded yet
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4762%252F18114762%252Fdocs_service_history-1773331680525.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddafb450d5fcfba3b63769f739e7e61a0%27 HTTP/1.1" 200 None
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4762/18114762/docs_service_history-1773331680525.jpeg?ixlib=js-3.8.0&auto=format&s=dafb450d5fcfba3b63769f739e7e61a0 not downloaded yet
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4591/20484591/exterior_front_driver-1774771792009.jpg> (referer: None)
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0427/13570427/interior_dashboard-1774711338400.jpg> (referer: None)
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_rear_driver-1774724007420.jpg> (referer: None)
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0427/13570427/instrument_cluster-1774714731104.jpg> (referer: None)
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2128d0>
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4591%252F20484591%252Fexterior_front_driver-1774771792009.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4591/20484591/exterior_front_driver-1774771792009.jpg saved to cache
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4762/18114762/18114762-instrument_cluster-modified-1774776534624.jpeg> (referer: None)
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9af010>
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Finterior_dashboard-1774711338400.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/interior_dashboard-1774711338400.jpg saved to cache
2026-03-29 20:30:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecc5d0>
2026-03-29 20:30:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4591%252F20484591%252Fexterior_rear_driver-1774724007420.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_rear_driver-1774724007420.jpg saved to cache
2026-03-29 20:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bce00621-6614-5cf0-bd96-7f64cffb8cb6
2026-03-29 20:30:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bce00621-6614-5cf0-bd96-7f64cffb8cb6, skipping ID generation
2026-03-29 20:30:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce00621-6614-5cf0-bd96-7f64cffb8cb6 with scrape type 1
2026-03-29 20:30:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bce00621-6614-5cf0-bd96-7f64cffb8cb6 sending to next pipeline
2026-03-29 20:30:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bce00621-6614-5cf0-bd96-7f64cffb8cb6, identifier: 20484591
2026-03-29 20:30:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce20ed0>
2026-03-29 20:30:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0427%252F13570427%252Finstrument_cluster-1774714731104.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0427/13570427/instrument_cluster-1774714731104.jpg saved to cache
2026-03-29 20:30:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bce00621-6614-5cf0-bd96-7f64cffb8cb6 with identifier: 20484591
2026-03-29 20:30:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bce00621-6614-5cf0-bd96-7f64cffb8cb6 with identifier: 20484591
2026-03-29 20:30:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bce00621-6614-5cf0-bd96-7f64cffb8cb6 with identifier: 20484591 to the API
2026-03-29 20:30:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_rear_driver-1774724007420.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bce00621-6614-5cf0-bd96-7f64cffb8cb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GX68 ASZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484591',
'listing': 'auction',
'location': 'Caerffili Newport',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 72000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1705000,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4591/20484591/exterior_front_driver-1774771792009.jpg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1544779,
'Height': 2601,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_rear_driver-1774724007420.jpg',
'Width': 3468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355108,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4591/20484591/exterior_front_passenger-1774724046862.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1874167,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4591/20484591/exterior_rear_passenger-1774771533691.jpg',
'Width': 3455},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763397,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4591/20484591/interior_front_seats-1774771629383.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2519586,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4591/20484591/interior_rear_seats-1774724571335.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1970346,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4591/20484591/interior_dashboard-1774724662631.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1709387,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4591/20484591/instrument_cluster-1774724575359.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2196340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4591/20484591/interior_boot-1774724547255.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce00621-6614-5cf0-bd96-7f64cffb8cb6/bce00621-6614-5cf0-bd96-7f64cffb8cb6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648943,
'Height': 2627,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4591/20484591/docs_service_history-1774724976515.jpg?ixlib=js-3.8.0&auto=format&s=a98f3582575e9097e42d68fc8e6f621d',
'Width': 1792}],
'price': 7512,
'price_includes_vat': False,
'registration_date': '2018-09-13',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Vitara SZ5',
'transmission': 'manual',
'trim': 'SZ5',
'vin': 'TSMLYD21S00493845',
'year': 2018}
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484591%27 HTTP/1.1" 200 None
2026-03-29 20:30:13 [motorway.uk] INFO: Saving data for 20484591: {'created_time': 1774816213.231377, 'last_price_update_time': 1774816213.231387, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484591') HTTP/1.1" 204 0
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d139910>
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4762%252F18114762%252F18114762-instrument_cluster-modified-1774776534624.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4762/18114762/18114762-instrument_cluster-modified-1774776534624.jpeg saved to cache
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4762/18114762/docs_service_history-1773331680525.jpeg?ixlib=js-3.8.0&auto=format&s=dafb450d5fcfba3b63769f739e7e61a0> (referer: None)
2026-03-29 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4762/18114762/18114762-interior_dashboard-modified-1774707125111.jpeg> (referer: None)
2026-03-29 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4762/18114762/interior_rear_seats-1773138918806.jpeg> (referer: None)
2026-03-29 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4762/18114762/interior_boot-1773138989082.jpeg> (referer: None)
2026-03-29 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20230861.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12c090>
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4762%252F18114762%252Fdocs_service_history-1773331680525.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddafb450d5fcfba3b63769f739e7e61a0') HTTP/1.1" 204 0
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4762/18114762/docs_service_history-1773331680525.jpeg?ixlib=js-3.8.0&auto=format&s=dafb450d5fcfba3b63769f739e7e61a0 saved to cache
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07f590>
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4762%252F18114762%252F18114762-interior_dashboard-modified-1774707125111.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4762/18114762/18114762-interior_dashboard-modified-1774707125111.jpeg saved to cache
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:30:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:30:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/u\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02YC\x00/kA\x00\x00\x00\x00'
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9ad790>
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4762%252F18114762%252Finterior_rear_seats-1773138918806.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4762/18114762/interior_rear_seats-1773138918806.jpeg saved to cache
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:30:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:30:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00AX<\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02t\xc8\x00AM\x9e\x00\x00\x00\x00'
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d15cd50>
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4762%252F18114762%252Finterior_boot-1773138989082.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4762/18114762/interior_boot-1773138989082.jpeg saved to cache
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 951e7e4b-228a-5f49-9e54-1e77b7610f36 with identifier: 20230861
2026-03-29 20:30:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951e7e4b-228a-5f49-9e54-1e77b7610f36 with scrape type 1
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 951e7e4b-228a-5f49-9e54-1e77b7610f36
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0861%252F20230861%252Fexterior_front_driver-1774707960666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0861/20230861/exterior_front_driver-1774707960666.jpg not downloaded yet
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0861%252F20230861%252Fexterior_rear_driver-1774708392639.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0861/20230861/exterior_rear_driver-1774708392639.jpg not downloaded yet
2026-03-29 20:30:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.805(s), this was the 1st time calling it.
2026-03-29 20:30:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.21815135318961 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0861%252F20230861%252Fexterior_front_passenger-1773315797347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0861/20230861/exterior_front_passenger-1773315797347.jpg already downloaded
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0861%252F20230861%252Fexterior_rear_passenger-1773315794479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0861/20230861/exterior_rear_passenger-1773315794479.jpg already downloaded
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0861%252F20230861%252Finterior_front_seats-1773316220495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0861/20230861/interior_front_seats-1773316220495.jpg already downloaded
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0861%252F20230861%252Finterior_rear_seats-1773316105926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0861/20230861/interior_rear_seats-1773316105926.jpg already downloaded
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0861%252F20230861%252Finterior_dashboard-1774708415958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0861/20230861/interior_dashboard-1774708415958.jpg not downloaded yet
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0861%252F20230861%252Finterior_boot-1773316271531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0861/20230861/interior_boot-1773316271531.jpg already downloaded
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0861%252F20230861%252Fdocs_service_history-1773316626371.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd025c865f0014000f9ede52c97d64810%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0861/20230861/docs_service_history-1773316626371.jpg?ixlib=js-3.8.0&auto=format&s=d025c865f0014000f9ede52c97d64810 already downloaded
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0861%252F20230861%252Fdocs_service_history-1773316697905.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De1632a8e03cc8bb525b9b67f6bb1b17b%27 HTTP/1.1" 200 None
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0861/20230861/docs_service_history-1773316697905.jpg?ixlib=js-3.8.0&auto=format&s=e1632a8e03cc8bb525b9b67f6bb1b17b not downloaded yet
2026-03-29 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_passenger-1773138556431.jpeg> (referer: None)
2026-03-29 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4762/18114762/interior_front_seats-1773138856353.jpeg> (referer: None)
2026-03-29 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_driver-1773138519371.jpeg> (referer: None)
2026-03-29 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_passenger-1773138542222.jpeg> (referer: None)
2026-03-29 20:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_driver-1773138565981.jpeg> (referer: None)
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e949910>
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_rear_passenger-1773138556431.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_passenger-1773138556431.jpeg saved to cache
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:30:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:30:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\xb5s\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa93\x000\xaa\xd5\x00\x00\x00\x00'
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e997f90>
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4762%252F18114762%252Finterior_front_seats-1773138856353.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4762/18114762/interior_front_seats-1773138856353.jpeg saved to cache
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d057a10>
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_front_driver-1773138519371.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_driver-1773138519371.jpeg saved to cache
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec81690>
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_front_passenger-1773138542222.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_passenger-1773138542222.jpeg saved to cache
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cab0d10>
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4762%252F18114762%252Fexterior_rear_driver-1773138565981.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_driver-1773138565981.jpeg saved to cache
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1
2026-03-29 20:30:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02db23df-d2db-5085-b004-c9fc5aeaa3e1, skipping ID generation
2026-03-29 20:30:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1 with scrape type 1
2026-03-29 20:30:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02db23df-d2db-5085-b004-c9fc5aeaa3e1 sending to next pipeline
2026-03-29 20:30:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 02db23df-d2db-5085-b004-c9fc5aeaa3e1, identifier: 18114762
2026-03-29 20:30:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 02db23df-d2db-5085-b004-c9fc5aeaa3e1 with identifier: 18114762
2026-03-29 20:30:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 02db23df-d2db-5085-b004-c9fc5aeaa3e1 with identifier: 18114762
2026-03-29 20:30:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 02db23df-d2db-5085-b004-c9fc5aeaa3e1 with identifier: 18114762 to the API
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_driver-1773138565981.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '02db23df-d2db-5085-b004-c9fc5aeaa3e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YJ21 NRB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18114762',
'listing': 'auction',
'location': 'Greater London Barnet',
'make': 'MINI',
'model': 'Cooper',
'odometer': 25050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1558179,
'Height': 2604,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_driver-1773138519371.jpeg',
'Width': 3472},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1732577,
'Height': 2704,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_driver-1773138565981.jpeg',
'Width': 3605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1516900,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_front_passenger-1773138542222.jpeg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663162,
'Height': 2664,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4762/18114762/exterior_rear_passenger-1773138556431.jpeg',
'Width': 3552},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3366566,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4762/18114762/interior_front_seats-1773138856353.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3264290,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4762/18114762/interior_rear_seats-1773138918806.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2860438,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4762/18114762/18114762-interior_dashboard-modified-1774707125111.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517136,
'Height': 1426,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4762/18114762/18114762-instrument_cluster-modified-1774776534624.jpeg',
'Width': 1901},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4443396,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4762/18114762/interior_boot-1773138989082.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02db23df-d2db-5085-b004-c9fc5aeaa3e1/02db23df-d2db-5085-b004-c9fc5aeaa3e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1484183,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4762/18114762/docs_service_history-1773331680525.jpeg?ixlib=js-3.8.0&auto=format&s=dafb450d5fcfba3b63769f739e7e61a0',
'Width': 3024}],
'price': 14684,
'price_includes_vat': False,
'registration_date': '2021-06-14',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Exclusive Auto',
'transmission': 'automatic',
'trim': 'Exclusive Auto',
'vin': 'WMW32DK0202R00346',
'year': 2021}
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718114762%27 HTTP/1.1" 200 None
2026-03-29 20:30:15 [motorway.uk] INFO: Saving data for 18114762: {'created_time': 1774816215.417935, 'last_price_update_time': 1774816215.417945, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18114762') HTTP/1.1" 204 0
2026-03-29 20:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0861/20230861/docs_service_history-1773316697905.jpg?ixlib=js-3.8.0&auto=format&s=e1632a8e03cc8bb525b9b67f6bb1b17b> (referer: None)
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cab0f10>
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0861%252F20230861%252Fdocs_service_history-1773316697905.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De1632a8e03cc8bb525b9b67f6bb1b17b') HTTP/1.1" 204 0
2026-03-29 20:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0861/20230861/docs_service_history-1773316697905.jpg?ixlib=js-3.8.0&auto=format&s=e1632a8e03cc8bb525b9b67f6bb1b17b saved to cache
2026-03-29 20:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 951e7e4b-228a-5f49-9e54-1e77b7610f36
2026-03-29 20:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0861/20230861/exterior_front_driver-1774707960666.jpg> (referer: None)
2026-03-29 20:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0427/13570427/interior_rear_seats-1774711316780.jpg> (referer: None)
2026-03-29 20:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0861/20230861/interior_dashboard-1774708415958.jpg> (referer: None)
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e066150>
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0861%252F20230861%252Fexterior_front_driver-1774707960666.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0861/20230861/exterior_front_driver-1774707960666.jpg saved to cache
2026-03-29 20:30:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 951e7e4b-228a-5f49-9e54-1e77b7610f36
2026-03-29 20:30:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d041050>
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0427%252F13570427%252Finterior_rear_seats-1774711316780.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0427/13570427/interior_rear_seats-1774711316780.jpg saved to cache
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d7710>
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0861%252F20230861%252Finterior_dashboard-1774708415958.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0861/20230861/interior_dashboard-1774708415958.jpg saved to cache
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 951e7e4b-228a-5f49-9e54-1e77b7610f36
2026-03-29 20:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0427/13570427/interior_front_seats-1774711294454.jpg> (referer: None)
2026-03-29 20:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0861/20230861/exterior_rear_driver-1774708392639.jpg> (referer: None)
2026-03-29 20:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_passenger-1774711013047.jpg> (referer: None)
2026-03-29 20:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_passenger-1774711813118.jpg> (referer: None)
2026-03-29 20:30:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca4b550>
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0427%252F13570427%252Finterior_front_seats-1774711294454.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0427/13570427/interior_front_seats-1774711294454.jpg saved to cache
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e0646d0>
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0861%252F20230861%252Fexterior_rear_driver-1774708392639.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0861/20230861/exterior_rear_driver-1774708392639.jpg saved to cache
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 951e7e4b-228a-5f49-9e54-1e77b7610f36
2026-03-29 20:30:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 951e7e4b-228a-5f49-9e54-1e77b7610f36, skipping ID generation
2026-03-29 20:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951e7e4b-228a-5f49-9e54-1e77b7610f36 with scrape type 1
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 951e7e4b-228a-5f49-9e54-1e77b7610f36 sending to next pipeline
2026-03-29 20:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 951e7e4b-228a-5f49-9e54-1e77b7610f36, identifier: 20230861
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cab3090>
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_front_passenger-1774711013047.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_passenger-1774711013047.jpg saved to cache
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca6c690>
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_rear_passenger-1774711813118.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_passenger-1774711813118.jpg saved to cache
2026-03-29 20:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 951e7e4b-228a-5f49-9e54-1e77b7610f36 with identifier: 20230861
2026-03-29 20:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 951e7e4b-228a-5f49-9e54-1e77b7610f36 with identifier: 20230861
2026-03-29 20:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 951e7e4b-228a-5f49-9e54-1e77b7610f36 with identifier: 20230861 to the API
2026-03-29 20:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0861/20230861/exterior_rear_driver-1774708392639.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '951e7e4b-228a-5f49-9e54-1e77b7610f36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WN68 UXX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20230861',
'listing': 'auction',
'location': 'Wiltshire Trowbridge',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 36400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2048144,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0861/20230861/exterior_front_driver-1774707960666.jpg',
'Width': 3327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2732469,
'Height': 2871,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0861/20230861/exterior_rear_driver-1774708392639.jpg',
'Width': 3828},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef22d03-a61f-5cb3-86da-5d02986342a5/4ef22d03-a61f-5cb3-86da-5d02986342a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1450791,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0861/20230861/exterior_front_passenger-1773315797347.jpg',
'Width': 3230},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef22d03-a61f-5cb3-86da-5d02986342a5/4ef22d03-a61f-5cb3-86da-5d02986342a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1776218,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0861/20230861/exterior_rear_passenger-1773315794479.jpg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef22d03-a61f-5cb3-86da-5d02986342a5/4ef22d03-a61f-5cb3-86da-5d02986342a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4043565,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0861/20230861/interior_front_seats-1773316220495.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef22d03-a61f-5cb3-86da-5d02986342a5/4ef22d03-a61f-5cb3-86da-5d02986342a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4522428,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0861/20230861/interior_rear_seats-1773316105926.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326159,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0861/20230861/interior_dashboard-1774708415958.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef22d03-a61f-5cb3-86da-5d02986342a5/4ef22d03-a61f-5cb3-86da-5d02986342a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3290414,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0861/20230861/interior_boot-1773316271531.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef22d03-a61f-5cb3-86da-5d02986342a5/4ef22d03-a61f-5cb3-86da-5d02986342a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381427,
'Height': 1776,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0861/20230861/docs_service_history-1773316626371.jpg?ixlib=js-3.8.0&auto=format&s=d025c865f0014000f9ede52c97d64810',
'Width': 3115},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_951e7e4b-228a-5f49-9e54-1e77b7610f36/951e7e4b-228a-5f49-9e54-1e77b7610f36_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1050759,
'Height': 3813,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0861/20230861/docs_service_history-1773316697905.jpg?ixlib=js-3.8.0&auto=format&s=e1632a8e03cc8bb525b9b67f6bb1b17b',
'Width': 5191}],
'price': 11908,
'price_includes_vat': False,
'registration_date': '2018-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson Premium T-GDi 2WD',
'transmission': 'manual',
'trim': 'Premium T-GDi 2WD',
'vin': 'TMAJ3812LKJ713066',
'year': 2018}
2026-03-29 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720230861%27 HTTP/1.1" 200 None
2026-03-29 20:30:17 [motorway.uk] INFO: Saving data for 20230861: {'created_time': 1774816217.885941, 'last_price_update_time': 1774816217.885952, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20230861') HTTP/1.1" 204 0
2026-03-29 20:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_driver-1774710991895.jpg> (referer: None)
2026-03-29 20:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_driver-1774710977260.jpg> (referer: None)
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea57c50>
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_rear_driver-1774710991895.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_driver-1774710991895.jpg saved to cache
2026-03-29 20:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7caa10>
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0427%252F13570427%252Fexterior_front_driver-1774710977260.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_driver-1774710977260.jpg saved to cache
2026-03-29 20:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e
2026-03-29 20:30:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e8c69ff-15ae-5862-90f5-9a3bc8af491e, skipping ID generation
2026-03-29 20:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e with scrape type 1
2026-03-29 20:30:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e8c69ff-15ae-5862-90f5-9a3bc8af491e sending to next pipeline
2026-03-29 20:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9e8c69ff-15ae-5862-90f5-9a3bc8af491e, identifier: 13570427
2026-03-29 20:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9e8c69ff-15ae-5862-90f5-9a3bc8af491e with identifier: 13570427
2026-03-29 20:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9e8c69ff-15ae-5862-90f5-9a3bc8af491e with identifier: 13570427
2026-03-29 20:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9e8c69ff-15ae-5862-90f5-9a3bc8af491e with identifier: 13570427 to the API
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_driver-1774710977260.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '9e8c69ff-15ae-5862-90f5-9a3bc8af491e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KM22 YFH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13570427',
'listing': 'auction',
'location': 'None None',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1873386,
'Height': 2869,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_driver-1774710977260.jpg',
'Width': 3825},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539695,
'Height': 2789,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_driver-1774710991895.jpg',
'Width': 3719},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1489619,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_front_passenger-1774711013047.jpg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1569440,
'Height': 2802,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0427/13570427/exterior_rear_passenger-1774711813118.jpg',
'Width': 3736},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3494130,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0427/13570427/interior_front_seats-1774711294454.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538004,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0427/13570427/interior_rear_seats-1774711316780.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1340327,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0427/13570427/interior_dashboard-1774711338400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405809,
'Height': 1251,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0427/13570427/instrument_cluster-1774714731104.jpg',
'Width': 1668},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2712490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0427/13570427/interior_boot-1774711348641.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e8c69ff-15ae-5862-90f5-9a3bc8af491e/9e8c69ff-15ae-5862-90f5-9a3bc8af491e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1809945,
'Height': 2579,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0427/13570427/docs_service_history-1774715231533.jpg?ixlib=js-3.8.0&auto=format&s=a7e0c4f9454a35d38955efbd6392185a',
'Width': 3439}],
'price': 16899,
'price_includes_vat': False,
'registration_date': '2022-06-13',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Cross Excel HEV Auto',
'transmission': 'automatic',
'trim': 'Cross Excel HEV Auto',
'vin': 'JTDKBABB30A067368',
'year': 2022}
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713570427%27 HTTP/1.1" 200 None
2026-03-29 20:30:18 [motorway.uk] INFO: Saving data for 13570427: {'created_time': 1774816218.860429, 'last_price_update_time': 1774816218.860442, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13570427') HTTP/1.1" 204 0
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20257737.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_passenger-1774634036836.jpg> (referer: None)
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_passenger-1774634055767.jpg> (referer: None)
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4822/19584822/interior_dashboard-1774634864540.jpg> (referer: None)
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4822/19584822/interior_front_seats-1774634782071.jpg> (referer: None)
2026-03-29 20:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4822/19584822/interior_rear_seats-1774634799050.jpg> (referer: None)
2026-03-29 20:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af0f1621-3ab1-5907-aac2-3dbb1fb0289d with identifier: 20257737
2026-03-29 20:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d with scrape type 1
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_front_driver-1774720645511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_driver-1774720645511.jpg not downloaded yet
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_rear_driver-1774720558591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_driver-1774720558591.jpg not downloaded yet
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2fd10>
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_rear_passenger-1774634036836.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_passenger-1774634036836.jpg saved to cache
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1a10>
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_front_passenger-1774634055767.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_passenger-1774634055767.jpg saved to cache
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14fcc650>
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Finterior_dashboard-1774634864540.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/interior_dashboard-1774634864540.jpg saved to cache
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb69d0>
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Finterior_front_seats-1774634782071.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/interior_front_seats-1774634782071.jpg saved to cache
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd25d0>
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4822%252F19584822%252Finterior_rear_seats-1774634799050.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4822/19584822/interior_rear_seats-1774634799050.jpg saved to cache
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_front_passenger-1774720662850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_passenger-1774720662850.jpg not downloaded yet
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_rear_passenger-1774720557867.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_passenger-1774720557867.jpg not downloaded yet
2026-03-29 20:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_driver-1774634073166.jpg> (referer: None)
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7737%252F20257737%252Finterior_front_seats-1774721462299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7737/20257737/interior_front_seats-1774721462299.jpg not downloaded yet
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7737%252F20257737%252Finterior_rear_seats-1774721430655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7737/20257737/interior_rear_seats-1774721430655.jpg not downloaded yet
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Finterior_dashboard-1774721441739.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/interior_dashboard-1774721441739.jpg not downloaded yet
2026-03-29 20:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_passenger-1774434606003.jpg> (referer: None)
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Finstrument_cluster-1774722139850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/instrument_cluster-1774722139850.jpg not downloaded yet
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7737%252F20257737%252Finterior_boot-1774721431591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7737/20257737/interior_boot-1774721431591.jpg not downloaded yet
2026-03-29 20:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_driver-1774634085483.jpg> (referer: None)
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7737%252F20257737%252Fdocs_service_history-1774721834697.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29cd9fcfcd83e42badcae1c6c56d30e3%27 HTTP/1.1" 200 None
2026-03-29 20:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7737/20257737/docs_service_history-1774721834697.jpg?ixlib=js-3.8.0&auto=format&s=29cd9fcfcd83e42badcae1c6c56d30e3 not downloaded yet
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cafa610>
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_front_driver-1774634073166.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_driver-1774634073166.jpg saved to cache
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_driver-1774720645511.jpg> (referer: None)
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d757e50>
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_rear_passenger-1774434606003.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_passenger-1774434606003.jpg saved to cache
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ce950>
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4822%252F19584822%252Fexterior_rear_driver-1774634085483.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_driver-1774634085483.jpg saved to cache
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab48d8e8-646f-50f6-b6f4-085a502431ea
2026-03-29 20:30:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab48d8e8-646f-50f6-b6f4-085a502431ea, skipping ID generation
2026-03-29 20:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab48d8e8-646f-50f6-b6f4-085a502431ea with scrape type 1
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab48d8e8-646f-50f6-b6f4-085a502431ea sending to next pipeline
2026-03-29 20:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ab48d8e8-646f-50f6-b6f4-085a502431ea, identifier: 19584822
2026-03-29 20:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ab48d8e8-646f-50f6-b6f4-085a502431ea with identifier: 19584822
2026-03-29 20:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ab48d8e8-646f-50f6-b6f4-085a502431ea with identifier: 19584822
2026-03-29 20:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ab48d8e8-646f-50f6-b6f4-085a502431ea with identifier: 19584822 to the API
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_driver-1774634085483.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ab48d8e8-646f-50f6-b6f4-085a502431ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LV13 YNC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19584822',
'listing': 'auction',
'location': 'Greater London Sidcup',
'make': 'Ford',
'model': 'Ka',
'odometer': 53400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 843343,
'Height': 1903,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_driver-1774634073166.jpg',
'Width': 2537},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1055194,
'Height': 2056,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_driver-1774634085483.jpg',
'Width': 2741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1123891,
'Height': 2351,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_front_passenger-1774634055767.jpg',
'Width': 3135},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 772047,
'Height': 1863,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4822/19584822/exterior_rear_passenger-1774634036836.jpg',
'Width': 2484},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959894,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4822/19584822/interior_front_seats-1774634782071.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2382131,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4822/19584822/interior_rear_seats-1774634799050.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1402276,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4822/19584822/interior_dashboard-1774634864540.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2097030,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4822/19584822/instrument_cluster-1774634880508.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3241489,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4822/19584822/interior_boot-1774634850420.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab48d8e8-646f-50f6-b6f4-085a502431ea/ab48d8e8-646f-50f6-b6f4-085a502431ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2806258,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4822/19584822/damage_scratches-1774634169430.jpg',
'Width': 4032}],
'price': 1474,
'price_includes_vat': False,
'registration_date': '2013-07-29',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ka Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0UXXLTRUDA31376',
'year': 2013}
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719584822%27 HTTP/1.1" 200 None
2026-03-29 20:30:20 [motorway.uk] INFO: Saving data for 19584822: {'created_time': 1774816220.83204, 'last_price_update_time': 1774816220.83205, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19584822') HTTP/1.1" 204 0
2026-03-29 20:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20468681.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ceb1a90>
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_front_driver-1774720645511.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_driver-1774720645511.jpg saved to cache
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_driver-1774720558591.jpg> (referer: None)
2026-03-29 20:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aecca6c5-419a-5950-b0eb-1b724ff0fe23 with identifier: 20468681
2026-03-29 20:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aecca6c5-419a-5950-b0eb-1b724ff0fe23 with scrape type 1
2026-03-29 20:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8681%252F20468681%252Fexterior_front_driver-1774707003512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_driver-1774707003512.jpg not downloaded yet
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_passenger-1774720662850.jpg> (referer: None)
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8681%252F20468681%252Fexterior_rear_driver-1774708223992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_driver-1774708223992.jpg not downloaded yet
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8681%252F20468681%252Fexterior_front_passenger-1774707054366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_passenger-1774707054366.jpg not downloaded yet
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8681%252F20468681%252Fexterior_rear_passenger-1774708278174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_passenger-1774708278174.jpg not downloaded yet
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7737/20257737/interior_rear_seats-1774721430655.jpg> (referer: None)
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7737/20257737/interior_boot-1774721431591.jpg> (referer: None)
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8681%252F20468681%252Finterior_front_seats-1774707358311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8681/20468681/interior_front_seats-1774707358311.jpg not downloaded yet
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9aff90>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_rear_driver-1774720558591.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_driver-1774720558591.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7737/20257737/docs_service_history-1774721834697.jpg?ixlib=js-3.8.0&auto=format&s=29cd9fcfcd83e42badcae1c6c56d30e3> (referer: None)
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8681%252F20468681%252Finterior_rear_seats-1774707374892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8681/20468681/interior_rear_seats-1774707374892.jpg not downloaded yet
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8681%252F20468681%252Finterior_dashboard-1774708378343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8681/20468681/interior_dashboard-1774708378343.jpg not downloaded yet
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea87dd0>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_front_passenger-1774720662850.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_passenger-1774720662850.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8681%252F20468681%252Finstrument_cluster-1774707466403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8681/20468681/instrument_cluster-1774707466403.jpg not downloaded yet
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:10:24\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadc650>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7737%252F20257737%252Finterior_rear_seats-1774721430655.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7737/20257737/interior_rear_seats-1774721430655.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:09:12\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea84a10>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7737%252F20257737%252Finterior_boot-1774721431591.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7737/20257737/interior_boot-1774721431591.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7737/20257737/interior_dashboard-1774721441739.jpg> (referer: None)
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8681%252F20468681%252Finterior_boot-1774707416376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8681/20468681/interior_boot-1774707416376.jpg not downloaded yet
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e909310>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7737%252F20257737%252Fdocs_service_history-1774721834697.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29cd9fcfcd83e42badcae1c6c56d30e3') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7737/20257737/docs_service_history-1774721834697.jpg?ixlib=js-3.8.0&auto=format&s=29cd9fcfcd83e42badcae1c6c56d30e3 saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8681%252F20468681%252Fdocs_service_history-1774707506610.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df69251dee4d728e10067be705b9adb37%27 HTTP/1.1" 200 None
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8681/20468681/docs_service_history-1774707506610.jpg?ixlib=js-3.8.0&auto=format&s=f69251dee4d728e10067be705b9adb37 not downloaded yet
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6587/19346587/interior_boot-1774772804393.jpg> (referer: None)
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_driver-1774707003512.jpg> (referer: None)
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_passenger-1774707054366.jpg> (referer: None)
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c23e310>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Finterior_dashboard-1774721441739.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/interior_dashboard-1774721441739.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_passenger-1774708278174.jpg> (referer: None)
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8681/20468681/interior_front_seats-1774707358311.jpg> (referer: None)
2026-03-29 20:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8681/20468681/docs_service_history-1774707506610.jpg?ixlib=js-3.8.0&auto=format&s=f69251dee4d728e10067be705b9adb37> (referer: None)
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e969910>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6587%252F19346587%252Finterior_boot-1774772804393.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6587/19346587/interior_boot-1774772804393.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c1350>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8681%252F20468681%252Fexterior_front_driver-1774707003512.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_driver-1774707003512.jpg saved to cache
2026-03-29 20:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cedc190>
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8681%252F20468681%252Fexterior_front_passenger-1774707054366.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_passenger-1774707054366.jpg saved to cache
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c1350>
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8681%252F20468681%252Fexterior_rear_passenger-1774708278174.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_passenger-1774708278174.jpg saved to cache
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d82d0>
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8681%252F20468681%252Finterior_front_seats-1774707358311.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8681/20468681/interior_front_seats-1774707358311.jpg saved to cache
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed90e10>
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8681%252F20468681%252Fdocs_service_history-1774707506610.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df69251dee4d728e10067be705b9adb37') HTTP/1.1" 204 0
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8681/20468681/docs_service_history-1774707506610.jpg?ixlib=js-3.8.0&auto=format&s=f69251dee4d728e10067be705b9adb37 saved to cache
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7737/20257737/instrument_cluster-1774722139850.jpg> (referer: None)
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8681/20468681/interior_dashboard-1774708378343.jpg> (referer: None)
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:20:05\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:30:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebeda90>
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Finstrument_cluster-1774722139850.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/instrument_cluster-1774722139850.jpg saved to cache
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d069910>
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8681%252F20468681%252Finterior_dashboard-1774708378343.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8681/20468681/interior_dashboard-1774708378343.jpg saved to cache
2026-03-29 20:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_driver-1774708223992.jpg> (referer: None)
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8681/20468681/instrument_cluster-1774707466403.jpg> (referer: None)
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7737/20257737/interior_front_seats-1774721462299.jpg> (referer: None)
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_passenger-1774720557867.jpg> (referer: None)
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8681/20468681/interior_boot-1774707416376.jpg> (referer: None)
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1044&page=29&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8681/20468681/interior_rear_seats-1774707374892.jpg> (referer: None)
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ebee950>
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8681%252F20468681%252Fexterior_rear_driver-1774708223992.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_driver-1774708223992.jpg saved to cache
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cba9e10>
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8681%252F20468681%252Finstrument_cluster-1774707466403.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8681/20468681/instrument_cluster-1774707466403.jpg saved to cache
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 18:10:57\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d14a950>
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7737%252F20257737%252Finterior_front_seats-1774721462299.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7737/20257737/interior_front_seats-1774721462299.jpg saved to cache
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ede95d0>
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7737%252F20257737%252Fexterior_rear_passenger-1774720557867.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_passenger-1774720557867.jpg saved to cache
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d
2026-03-29 20:30:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af0f1621-3ab1-5907-aac2-3dbb1fb0289d, skipping ID generation
2026-03-29 20:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d with scrape type 1
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af0f1621-3ab1-5907-aac2-3dbb1fb0289d sending to next pipeline
2026-03-29 20:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: af0f1621-3ab1-5907-aac2-3dbb1fb0289d, identifier: 20257737
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca37510>
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8681%252F20468681%252Finterior_boot-1774707416376.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8681/20468681/interior_boot-1774707416376.jpg saved to cache
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:23 [motorway.uk] INFO: Found listing with ID: 20481167
2026-03-29 20:30:23 [motorway.uk] INFO: Found listing with ID: 11262426
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711262426%27 HTTP/1.1" 200 None
2026-03-29 20:30:23 [motorway.uk] INFO: Scrape type for 11262426: 1
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e051e90>
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8681%252F20468681%252Finterior_rear_seats-1774707374892.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8681/20468681/interior_rear_seats-1774707374892.jpg saved to cache
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aecca6c5-419a-5950-b0eb-1b724ff0fe23
2026-03-29 20:30:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aecca6c5-419a-5950-b0eb-1b724ff0fe23, skipping ID generation
2026-03-29 20:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aecca6c5-419a-5950-b0eb-1b724ff0fe23 with scrape type 1
2026-03-29 20:30:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aecca6c5-419a-5950-b0eb-1b724ff0fe23 sending to next pipeline
2026-03-29 20:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aecca6c5-419a-5950-b0eb-1b724ff0fe23, identifier: 20468681
2026-03-29 20:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: af0f1621-3ab1-5907-aac2-3dbb1fb0289d with identifier: 20257737
2026-03-29 20:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: af0f1621-3ab1-5907-aac2-3dbb1fb0289d with identifier: 20257737
2026-03-29 20:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: af0f1621-3ab1-5907-aac2-3dbb1fb0289d with identifier: 20257737 to the API
2026-03-29 20:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_passenger-1774720557867.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'af0f1621-3ab1-5907-aac2-3dbb1fb0289d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'L66 AFR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20257737',
'listing': 'auction',
'location': 'Cheshire East Wilmslow',
'make': 'Mercedes',
'model': 'GLA',
'odometer': 66950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281037,
'Height': 891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_driver-1774720645511.jpg',
'Width': 1188},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254789,
'Height': 915,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_driver-1774720558591.jpg',
'Width': 1220},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359042,
'Height': 1022,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_front_passenger-1774720662850.jpg',
'Width': 1362},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276269,
'Height': 937,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7737/20257737/exterior_rear_passenger-1774720557867.jpg',
'Width': 1249},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 852844,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/7737/20257737/interior_front_seats-1774721462299.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791079,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/7737/20257737/interior_rear_seats-1774721430655.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220217,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7737/20257737/interior_dashboard-1774721441739.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774478,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7737/20257737/instrument_cluster-1774722139850.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 849116,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/7737/20257737/interior_boot-1774721431591.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af0f1621-3ab1-5907-aac2-3dbb1fb0289d/af0f1621-3ab1-5907-aac2-3dbb1fb0289d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137684,
'Height': 1600,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7737/20257737/docs_service_history-1774721834697.jpg?ixlib=js-3.8.0&auto=format&s=29cd9fcfcd83e42badcae1c6c56d30e3',
'Width': 1201}],
'price': 11780,
'price_includes_vat': False,
'registration_date': '2017-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLA 220 AMG Line Prem + D 4M A',
'transmission': 'automatic',
'trim': '220 AMG Line Prem + D 4M A',
'vin': 'WDC1569052J432612',
'year': 2017}
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720257737%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Saving data for 20257737: {'created_time': 1774816225.257045, 'last_price_update_time': 1774816225.257058, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20257737') HTTP/1.1" 204 0
2026-03-29 20:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aecca6c5-419a-5950-b0eb-1b724ff0fe23 with identifier: 20468681
2026-03-29 20:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aecca6c5-419a-5950-b0eb-1b724ff0fe23 with identifier: 20468681
2026-03-29 20:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aecca6c5-419a-5950-b0eb-1b724ff0fe23 with identifier: 20468681 to the API
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8681/20468681/interior_rear_seats-1774707374892.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'aecca6c5-419a-5950-b0eb-1b724ff0fe23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA11 CRN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20468681',
'listing': 'auction',
'location': 'West Sussex Crawley',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 81460,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1897528,
'Height': 2706,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_driver-1774707003512.jpg',
'Width': 3608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2214117,
'Height': 2670,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_driver-1774708223992.jpg',
'Width': 3560},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1856574,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8681/20468681/exterior_front_passenger-1774707054366.jpg',
'Width': 3507},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2785911,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8681/20468681/exterior_rear_passenger-1774708278174.jpg',
'Width': 3747},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4418898,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8681/20468681/interior_front_seats-1774707358311.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4218165,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8681/20468681/interior_rear_seats-1774707374892.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1968923,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8681/20468681/interior_dashboard-1774708378343.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383359,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8681/20468681/instrument_cluster-1774707466403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3205815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8681/20468681/interior_boot-1774707416376.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aecca6c5-419a-5950-b0eb-1b724ff0fe23/aecca6c5-419a-5950-b0eb-1b724ff0fe23_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258890,
'Height': 1736,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8681/20468681/docs_service_history-1774707506610.jpg?ixlib=js-3.8.0&auto=format&s=f69251dee4d728e10067be705b9adb37',
'Width': 2288}],
'price': 11804,
'price_includes_vat': False,
'registration_date': '2019-04-26',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 220 Sport Premium + D Auto',
'transmission': 'automatic',
'trim': 'C 220 Sport Premium + D Auto',
'vin': 'WDD2050142R498710',
'year': 2019}
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468681%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Saving data for 20468681: {'created_time': 1774816225.771784, 'last_price_update_time': 1774816225.771797, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20468681') HTTP/1.1" 204 0
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 19102337
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20421191
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421191%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 20421191: 1
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20228423
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20365167
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 16886677
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716886677%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 16886677: 1
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20489690
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 5776267
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20487109
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20254081
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 18038036
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718038036%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 18038036: 1
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20473354
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20172363
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20323228
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20486197
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 16378604
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20456017
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 17631330
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 12503630
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 19805155
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719805155%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 19805155: 1
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20484488
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 19543159
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 11178434
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20434695
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720434695%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 20434695: 2
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20490377
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490377%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 20490377: 1
2026-03-29 20:30:25 [motorway.uk] INFO: Found listing with ID: 20488936
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488936%27 HTTP/1.1" 200 None
2026-03-29 20:30:25 [motorway.uk] INFO: Scrape type for 20488936: 1
2026-03-29 20:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6587/19346587/interior_dashboard-1774787793330.jpg> (referer: None)
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 20484850
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 19905225
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 18671000
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 15950437
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 12936291
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 19919784
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 20285746
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 20473072
2026-03-29 20:30:26 [motorway.uk] INFO: Found listing with ID: 19988748
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719988748%27 HTTP/1.1" 200 None
2026-03-29 20:30:26 [motorway.uk] INFO: Scrape type for 19988748: 1
2026-03-29 20:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6587/19346587/instrument_cluster-1774772844035.jpg> (referer: None)
2026-03-29 20:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_front_passenger-1774434614285.jpg> (referer: None)
2026-03-29 20:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6587/19346587/interior_front_seats-1774772726622.jpg> (referer: None)
2026-03-29 20:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_passenger-1774772218980.jpg> (referer: None)
2026-03-29 20:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_driver-1774434616224.jpg> (referer: None)
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec162d0>
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6587%252F19346587%252Finterior_dashboard-1774787793330.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6587/19346587/interior_dashboard-1774787793330.jpg saved to cache
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d09d0>
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Finstrument_cluster-1774772844035.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/instrument_cluster-1774772844035.jpg saved to cache
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c24f410>
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_front_passenger-1774434614285.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_front_passenger-1774434614285.jpg saved to cache
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:30:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07410>
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6587%252F19346587%252Finterior_front_seats-1774772726622.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6587/19346587/interior_front_seats-1774772726622.jpg saved to cache
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14fa2f10>
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6587%252F19346587%252Fexterior_rear_passenger-1774772218980.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_passenger-1774772218980.jpg saved to cache
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cede9d0>
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9715%252F20249715%252Fexterior_rear_driver-1774434616224.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_driver-1774434616224.jpg saved to cache
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3151c5cb-f06b-5a28-be0e-eb30d291749f
2026-03-29 20:30:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3151c5cb-f06b-5a28-be0e-eb30d291749f, skipping ID generation
2026-03-29 20:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3151c5cb-f06b-5a28-be0e-eb30d291749f with scrape type 1
2026-03-29 20:30:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3151c5cb-f06b-5a28-be0e-eb30d291749f sending to next pipeline
2026-03-29 20:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3151c5cb-f06b-5a28-be0e-eb30d291749f, identifier: 20249715
2026-03-29 20:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3151c5cb-f06b-5a28-be0e-eb30d291749f with identifier: 20249715
2026-03-29 20:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3151c5cb-f06b-5a28-be0e-eb30d291749f with identifier: 20249715
2026-03-29 20:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3151c5cb-f06b-5a28-be0e-eb30d291749f with identifier: 20249715 to the API
2026-03-29 20:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_driver-1774434616224.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '3151c5cb-f06b-5a28-be0e-eb30d291749f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'A7 OVR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20249715',
'listing': 'auction',
'location': 'Bridgend County Borough Bridgend',
'make': 'Ford',
'model': 'Kuga',
'odometer': 1600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1344824,
'Height': 2499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_driver-1774434616224.jpg',
'Width': 3332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1919767,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_front_passenger-1774434614285.jpg',
'Width': 3518},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 772235,
'Height': 2557,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9715/20249715/exterior_rear_passenger-1774434606003.jpg',
'Width': 3409},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1999884,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9715/20249715/interior_front_seats-1774435006837.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3130580,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9715/20249715/interior_rear_seats-1774435069977.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635592,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9715/20249715/interior_dashboard-1774435010537.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2039770,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9715/20249715/instrument_cluster-1774435051668.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2430558,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9715/20249715/interior_boot-1774435008544.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3151c5cb-f06b-5a28-be0e-eb30d291749f/3151c5cb-f06b-5a28-be0e-eb30d291749f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1221768,
'Height': 2529,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9715/20249715/wheels_front_driver-1774434746647.jpg',
'Width': 3372}],
'price': 27553,
'price_includes_vat': False,
'registration_date': '2025-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga ST-LINE X HEV CVT',
'transmission': 'automatic',
'trim': 'ST-LINE X HEV CVT',
'vin': 'WF0FXXWPMHRS81227',
'year': 2025}
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720249715%27 HTTP/1.1" 200 None
2026-03-29 20:30:28 [motorway.uk] INFO: Saving data for 20249715: {'created_time': 1774816228.105739, 'last_price_update_time': 1774816228.105752, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20249715') HTTP/1.1" 204 0
2026-03-29 20:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6587/19346587/interior_rear_seats-1774772749766.jpg> (referer: None)
2026-03-29 20:30:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0a1e10>
2026-03-29 20:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6587%252F19346587%252Finterior_rear_seats-1774772749766.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6587/19346587/interior_rear_seats-1774772749766.jpg saved to cache
2026-03-29 20:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 898077d8-d6cc-5928-9731-5e6d98b87b8a
2026-03-29 20:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 898077d8-d6cc-5928-9731-5e6d98b87b8a, skipping ID generation
2026-03-29 20:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898077d8-d6cc-5928-9731-5e6d98b87b8a with scrape type 1
2026-03-29 20:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 898077d8-d6cc-5928-9731-5e6d98b87b8a sending to next pipeline
2026-03-29 20:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 898077d8-d6cc-5928-9731-5e6d98b87b8a, identifier: 19346587
2026-03-29 20:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 898077d8-d6cc-5928-9731-5e6d98b87b8a with identifier: 19346587
2026-03-29 20:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 898077d8-d6cc-5928-9731-5e6d98b87b8a with identifier: 19346587
2026-03-29 20:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 898077d8-d6cc-5928-9731-5e6d98b87b8a with identifier: 19346587 to the API
2026-03-29 20:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6587/19346587/interior_rear_seats-1774772749766.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '898077d8-d6cc-5928-9731-5e6d98b87b8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DN73 LXJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19346587',
'listing': 'auction',
'location': 'Staffordshire Newcastle',
'make': 'BMW',
'model': '1 Series',
'odometer': 19873,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505507,
'Height': 2384,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_driver-1774772212602.jpg',
'Width': 3178},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1510636,
'Height': 2390,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_front_passenger-1774772258911.jpg',
'Width': 3186},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825688,
'Height': 2648,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6587/19346587/exterior_rear_passenger-1774772218980.jpg',
'Width': 3531},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3898337,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6587/19346587/interior_front_seats-1774772726622.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2902641,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6587/19346587/interior_rear_seats-1774772749766.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885058,
'Height': 1851,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6587/19346587/interior_dashboard-1774787793330.jpg',
'Width': 2468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1673286,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6587/19346587/instrument_cluster-1774772844035.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3123293,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6587/19346587/interior_boot-1774772804393.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_898077d8-d6cc-5928-9731-5e6d98b87b8a/898077d8-d6cc-5928-9731-5e6d98b87b8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 666986,
'Height': 2192,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6587/19346587/docs_service_history-1774787752464.jpg?ixlib=js-3.8.0&auto=format&s=41e3bd8d180e80333f77291ddeff75af',
'Width': 1644}],
'price': 23966,
'price_includes_vat': False,
'registration_date': '2023-10-19',
'seats_number': None,
'seller_name': None,
'title': 'BMW 128TI Auto',
'transmission': 'automatic',
'trim': '128TI Auto',
'vin': 'WBA7L520907N32299',
'year': 2023}
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719346587%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [motorway.uk] INFO: Saving data for 19346587: {'created_time': 1774816229.135327, 'last_price_update_time': 1774816229.135338, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19346587') HTTP/1.1" 204 0
2026-03-29 20:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20482892.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178520b7-01ec-5e91-9dfd-979a0fee2893 with identifier: 20482892
2026-03-29 20:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178520b7-01ec-5e91-9dfd-979a0fee2893 with scrape type 1
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_front_driver-1774681862425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_driver-1774681862425.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_rear_driver-1774681968316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_driver-1774681968316.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_front_passenger-1774682026068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_passenger-1774682026068.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_rear_passenger-1774681988591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_passenger-1774681988591.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2892%252F20482892%252Finterior_front_seats-1774682386537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2892/20482892/interior_front_seats-1774682386537.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2892%252F20482892%252Finterior_rear_seats-1774719768478.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2892/20482892/interior_rear_seats-1774719768478.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2892%252F20482892%252Finterior_dashboard-1774772148523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2892/20482892/interior_dashboard-1774772148523.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2892%252F20482892%252Finterior_boot-1774682360877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2892/20482892/interior_boot-1774682360877.jpg not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2892%252F20482892%252Fdocs_service_history-1774719189435.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1d79fc1abc3e0ec067bac3c5475f03b%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2892/20482892/docs_service_history-1774719189435.jpg?ixlib=js-3.8.0&auto=format&s=b1d79fc1abc3e0ec067bac3c5475f03b not downloaded yet
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2892%252F20482892%252Fdamage_scratches-1774771963848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2892/20482892/damage_scratches-1774771963848.jpg not downloaded yet
2026-03-29 20:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11262426.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdcf7fae-c724-5630-9824-9b40a228f917 with identifier: 11262426
2026-03-29 20:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdcf7fae-c724-5630-9824-9b40a228f917 with scrape type 1
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_front_driver-1774629549830.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_driver-1774629549830.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_rear_driver-1774629560586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_driver-1774629560586.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_front_passenger-1774629579599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_passenger-1774629579599.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_rear_passenger-1774629569817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_passenger-1774629569817.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2426%252F11262426%252Finterior_front_seats-1774629942815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2426/11262426/interior_front_seats-1774629942815.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Finterior_dashboard-1774629984616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/interior_dashboard-1774629984616.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Finstrument_cluster-1774630055435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/instrument_cluster-1774630055435.jpg not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2426%252F11262426%252Finterior_boot-1774629968092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2426/11262426/interior_boot-1774629968092.jpg not downloaded yet
2026-03-29 20:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2892/20482892/damage_scratches-1774771963848.jpg> (referer: None)
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2426%252F11262426%252Fdocs_service_history-1774630220153.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91c8f4d58c568d558294652ac93d439e%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2426/11262426/docs_service_history-1774630220153.jpg?ixlib=js-3.8.0&auto=format&s=91c8f4d58c568d558294652ac93d439e not downloaded yet
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2426%252F11262426%252Fdamage_scratches-1774629648947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2426/11262426/damage_scratches-1774629648947.jpg not downloaded yet
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d179310>
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2892%252F20482892%252Fdamage_scratches-1774771963848.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2892/20482892/damage_scratches-1774771963848.jpg saved to cache
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2426/11262426/interior_boot-1774629968092.jpg> (referer: None)
2026-03-29 20:30:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7d8350>
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2426%252F11262426%252Finterior_boot-1774629968092.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2426/11262426/interior_boot-1774629968092.jpg saved to cache
2026-03-29 20:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2426/11262426/damage_scratches-1774629648947.jpg> (referer: None)
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed79e90>
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2426%252F11262426%252Fdamage_scratches-1774629648947.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2426/11262426/damage_scratches-1774629648947.jpg saved to cache
2026-03-29 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2426/11262426/docs_service_history-1774630220153.jpg?ixlib=js-3.8.0&auto=format&s=91c8f4d58c568d558294652ac93d439e> (referer: None)
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ede8050>
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2426%252F11262426%252Fdocs_service_history-1774630220153.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91c8f4d58c568d558294652ac93d439e') HTTP/1.1" 204 0
2026-03-29 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2426/11262426/docs_service_history-1774630220153.jpg?ixlib=js-3.8.0&auto=format&s=91c8f4d58c568d558294652ac93d439e saved to cache
2026-03-29 20:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2426/11262426/instrument_cluster-1774630055435.jpg> (referer: None)
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed79d50>
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Finstrument_cluster-1774630055435.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/instrument_cluster-1774630055435.jpg saved to cache
2026-03-29 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2426/11262426/interior_dashboard-1774629984616.jpg> (referer: None)
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d179c50>
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Finterior_dashboard-1774629984616.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/interior_dashboard-1774629984616.jpg saved to cache
2026-03-29 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2426/11262426/interior_front_seats-1774629942815.jpg> (referer: None)
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d269e10>
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2426%252F11262426%252Finterior_front_seats-1774629942815.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2426/11262426/interior_front_seats-1774629942815.jpg saved to cache
2026-03-29 20:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_passenger-1774629569817.jpg> (referer: None)
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed79cd0>
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_rear_passenger-1774629569817.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_passenger-1774629569817.jpg saved to cache
2026-03-29 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_passenger-1774629579599.jpg> (referer: None)
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d027c50>
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_front_passenger-1774629579599.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_passenger-1774629579599.jpg saved to cache
2026-03-29 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_driver-1774629560586.jpg> (referer: None)
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9b8d50>
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_rear_driver-1774629560586.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_driver-1774629560586.jpg saved to cache
2026-03-29 20:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_driver-1774629549830.jpg> (referer: None)
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7d8610>
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2426%252F11262426%252Fexterior_front_driver-1774629549830.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_driver-1774629549830.jpg saved to cache
2026-03-29 20:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdcf7fae-c724-5630-9824-9b40a228f917
2026-03-29 20:30:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdcf7fae-c724-5630-9824-9b40a228f917, skipping ID generation
2026-03-29 20:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdcf7fae-c724-5630-9824-9b40a228f917 with scrape type 1
2026-03-29 20:30:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdcf7fae-c724-5630-9824-9b40a228f917 sending to next pipeline
2026-03-29 20:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bdcf7fae-c724-5630-9824-9b40a228f917, identifier: 11262426
2026-03-29 20:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bdcf7fae-c724-5630-9824-9b40a228f917 with identifier: 11262426
2026-03-29 20:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bdcf7fae-c724-5630-9824-9b40a228f917 with identifier: 11262426
2026-03-29 20:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bdcf7fae-c724-5630-9824-9b40a228f917 with identifier: 11262426 to the API
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_driver-1774629549830.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bdcf7fae-c724-5630-9824-9b40a228f917',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK10 UOB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11262426',
'listing': 'auction',
'location': 'Berkshire Newbury',
'make': 'Mazda',
'model': 'MX-5',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1103737,
'Height': 1934,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_driver-1774629549830.jpg',
'Width': 2578},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2019909,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_driver-1774629560586.jpg',
'Width': 3385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1729138,
'Height': 2240,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_front_passenger-1774629579599.jpg',
'Width': 2986},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203971,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2426/11262426/exterior_rear_passenger-1774629569817.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3522631,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2426/11262426/interior_front_seats-1774629942815.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3548372,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2426/11262426/interior_dashboard-1774629984616.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551728,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2426/11262426/instrument_cluster-1774630055435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150396,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2426/11262426/interior_boot-1774629968092.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 883704,
'Height': 2010,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2426/11262426/docs_service_history-1774630220153.jpg?ixlib=js-3.8.0&auto=format&s=91c8f4d58c568d558294652ac93d439e',
'Width': 3388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcf7fae-c724-5630-9824-9b40a228f917/bdcf7fae-c724-5630-9824-9b40a228f917_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3350914,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2426/11262426/damage_scratches-1774629648947.jpg',
'Width': 4032}],
'price': 3131,
'price_includes_vat': False,
'registration_date': '2010-04-07',
'seats_number': None,
'seller_name': None,
'title': 'Mazda MX-5 I Roadster Sport Tech',
'transmission': 'manual',
'trim': 'I Roadster Sport Tech',
'vin': 'JMZNC18F600207851',
'year': 2010}
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711262426%27 HTTP/1.1" 200 None
2026-03-29 20:30:39 [motorway.uk] INFO: Saving data for 11262426: {'created_time': 1774816239.66406, 'last_price_update_time': 1774816239.664071, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11262426') HTTP/1.1" 204 0
2026-03-29 20:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2892/20482892/docs_service_history-1774719189435.jpg?ixlib=js-3.8.0&auto=format&s=b1d79fc1abc3e0ec067bac3c5475f03b> (referer: None)
2026-03-29 20:30:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e073f50>
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2892%252F20482892%252Fdocs_service_history-1774719189435.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1d79fc1abc3e0ec067bac3c5475f03b') HTTP/1.1" 204 0
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2892/20482892/docs_service_history-1774719189435.jpg?ixlib=js-3.8.0&auto=format&s=b1d79fc1abc3e0ec067bac3c5475f03b saved to cache
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2892/20482892/interior_boot-1774682360877.jpg> (referer: None)
2026-03-29 20:30:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:30:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d026450>
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2892%252F20482892%252Finterior_boot-1774682360877.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2892/20482892/interior_boot-1774682360877.jpg saved to cache
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20297983.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73af8a35-351f-54e0-acb1-ed3dc006804b with identifier: 20297983
2026-03-29 20:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73af8a35-351f-54e0-acb1-ed3dc006804b with scrape type 1
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_front_driver-1774260134678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_driver-1774260134678.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_rear_driver-1774260151202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_driver-1774260151202.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_front_passenger-1774260189749.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_passenger-1774260189749.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_rear_passenger-1774260227215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_passenger-1774260227215.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7983%252F20297983%252Finterior_front_seats-1774260768731.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7983/20297983/interior_front_seats-1774260768731.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7983%252F20297983%252Finterior_rear_seats-1774260779891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7983/20297983/interior_rear_seats-1774260779891.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Finterior_dashboard-1774262053712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/interior_dashboard-1774262053712.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Finstrument_cluster-1774260836706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/instrument_cluster-1774260836706.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7983%252F20297983%252Finterior_boot-1774260793418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7983/20297983/interior_boot-1774260793418.jpg not downloaded yet
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7983%252F20297983%252Fdocs_service_history-1774261194347.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44cf94872daabb42c77e0fc35cb35339%27 HTTP/1.1" 200 None
2026-03-29 20:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7983/20297983/docs_service_history-1774261194347.jpg?ixlib=js-3.8.0&auto=format&s=44cf94872daabb42c77e0fc35cb35339 not downloaded yet
2026-03-29 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2892/20482892/interior_dashboard-1774772148523.jpg> (referer: None)
2026-03-29 20:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2892/20482892/interior_rear_seats-1774719768478.jpg> (referer: None)
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d179450>
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2892%252F20482892%252Finterior_dashboard-1774772148523.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2892/20482892/interior_dashboard-1774772148523.jpg saved to cache
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7983/20297983/docs_service_history-1774261194347.jpg?ixlib=js-3.8.0&auto=format&s=44cf94872daabb42c77e0fc35cb35339> (referer: None)
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21eb50>
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2892%252F20482892%252Finterior_rear_seats-1774719768478.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2892/20482892/interior_rear_seats-1774719768478.jpg saved to cache
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec1ebd0>
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7983%252F20297983%252Fdocs_service_history-1774261194347.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44cf94872daabb42c77e0fc35cb35339') HTTP/1.1" 204 0
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7983/20297983/docs_service_history-1774261194347.jpg?ixlib=js-3.8.0&auto=format&s=44cf94872daabb42c77e0fc35cb35339 saved to cache
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7983/20297983/instrument_cluster-1774260836706.jpg> (referer: None)
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cc350>
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Finstrument_cluster-1774260836706.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/instrument_cluster-1774260836706.jpg saved to cache
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7983/20297983/interior_boot-1774260793418.jpg> (referer: None)
2026-03-29 20:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7983/20297983/interior_dashboard-1774262053712.jpg> (referer: None)
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cd450>
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7983%252F20297983%252Finterior_boot-1774260793418.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7983/20297983/interior_boot-1774260793418.jpg saved to cache
2026-03-29 20:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eab2a90>
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Finterior_dashboard-1774262053712.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/interior_dashboard-1774262053712.jpg saved to cache
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7983/20297983/interior_rear_seats-1774260779891.jpg> (referer: None)
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ebd10>
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7983%252F20297983%252Finterior_rear_seats-1774260779891.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7983/20297983/interior_rear_seats-1774260779891.jpg saved to cache
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_passenger-1774260227215.jpg> (referer: None)
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cddd0>
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_rear_passenger-1774260227215.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_passenger-1774260227215.jpg saved to cache
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7983/20297983/interior_front_seats-1774260768731.jpg> (referer: None)
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d798350>
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7983%252F20297983%252Finterior_front_seats-1774260768731.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7983/20297983/interior_front_seats-1774260768731.jpg saved to cache
2026-03-29 20:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_passenger-1774260189749.jpg> (referer: None)
2026-03-29 20:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_driver-1774260151202.jpg> (referer: None)
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca4d50>
2026-03-29 20:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_front_passenger-1774260189749.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_passenger-1774260189749.jpg saved to cache
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ea310>
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_rear_driver-1774260151202.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_driver-1774260151202.jpg saved to cache
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_driver-1774260134678.jpg> (referer: None)
2026-03-29 20:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2892/20482892/interior_front_seats-1774682386537.jpg> (referer: None)
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cdd50>
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7983%252F20297983%252Fexterior_front_driver-1774260134678.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_driver-1774260134678.jpg saved to cache
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73af8a35-351f-54e0-acb1-ed3dc006804b
2026-03-29 20:30:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73af8a35-351f-54e0-acb1-ed3dc006804b, skipping ID generation
2026-03-29 20:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73af8a35-351f-54e0-acb1-ed3dc006804b with scrape type 1
2026-03-29 20:30:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73af8a35-351f-54e0-acb1-ed3dc006804b sending to next pipeline
2026-03-29 20:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 73af8a35-351f-54e0-acb1-ed3dc006804b, identifier: 20297983
2026-03-29 20:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73af8a35-351f-54e0-acb1-ed3dc006804b with identifier: 20297983
2026-03-29 20:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73af8a35-351f-54e0-acb1-ed3dc006804b with identifier: 20297983
2026-03-29 20:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73af8a35-351f-54e0-acb1-ed3dc006804b with identifier: 20297983 to the API
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_driver-1774260134678.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '73af8a35-351f-54e0-acb1-ed3dc006804b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY72 RVM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20297983',
'listing': 'auction',
'location': 'Surrey Epsom',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 14500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1273311,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_driver-1774260134678.jpg',
'Width': 3483},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1585725,
'Height': 2760,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_driver-1774260151202.jpg',
'Width': 3680},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1626856,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_front_passenger-1774260189749.jpg',
'Width': 3547},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1701078,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7983/20297983/exterior_rear_passenger-1774260227215.jpg',
'Width': 3486},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4494515,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7983/20297983/interior_front_seats-1774260768731.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3895078,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7983/20297983/interior_rear_seats-1774260779891.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742231,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7983/20297983/interior_dashboard-1774262053712.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2615678,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7983/20297983/instrument_cluster-1774260836706.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3118193,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7983/20297983/interior_boot-1774260793418.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73af8a35-351f-54e0-acb1-ed3dc006804b/73af8a35-351f-54e0-acb1-ed3dc006804b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707832,
'Height': 3119,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7983/20297983/docs_service_history-1774261194347.jpg?ixlib=js-3.8.0&auto=format&s=44cf94872daabb42c77e0fc35cb35339',
'Width': 2173}],
'price': 12950,
'price_includes_vat': False,
'registration_date': '2022-11-23',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Aygo X Edge VVT-i Auto',
'transmission': 'automatic',
'trim': 'X Edge VVT-i Auto',
'vin': 'JTDAGNAC500072558',
'year': 2022}
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720297983%27 HTTP/1.1" 200 None
2026-03-29 20:30:44 [motorway.uk] INFO: Saving data for 20297983: {'created_time': 1774816244.000229, 'last_price_update_time': 1774816244.000242, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20297983') HTTP/1.1" 204 0
2026-03-29 20:30:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:30:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976710>
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2892%252F20482892%252Finterior_front_seats-1774682386537.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2892/20482892/interior_front_seats-1774682386537.jpg saved to cache
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_passenger-1774682026068.jpg> (referer: None)
2026-03-29 20:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_passenger-1774681988591.jpg> (referer: None)
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c6546d0>
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_front_passenger-1774682026068.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_passenger-1774682026068.jpg saved to cache
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d179e10>
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_rear_passenger-1774681988591.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_passenger-1774681988591.jpg saved to cache
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_driver-1774681862425.jpg> (referer: None)
2026-03-29 20:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_driver-1774681968316.jpg> (referer: None)
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0cf090>
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_front_driver-1774681862425.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_driver-1774681862425.jpg saved to cache
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0566d0>
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2892%252F20482892%252Fexterior_rear_driver-1774681968316.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_driver-1774681968316.jpg saved to cache
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 178520b7-01ec-5e91-9dfd-979a0fee2893
2026-03-29 20:30:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 178520b7-01ec-5e91-9dfd-979a0fee2893, skipping ID generation
2026-03-29 20:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178520b7-01ec-5e91-9dfd-979a0fee2893 with scrape type 1
2026-03-29 20:30:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 178520b7-01ec-5e91-9dfd-979a0fee2893 sending to next pipeline
2026-03-29 20:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 178520b7-01ec-5e91-9dfd-979a0fee2893, identifier: 20482892
2026-03-29 20:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 178520b7-01ec-5e91-9dfd-979a0fee2893 with identifier: 20482892
2026-03-29 20:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 178520b7-01ec-5e91-9dfd-979a0fee2893 with identifier: 20482892
2026-03-29 20:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 178520b7-01ec-5e91-9dfd-979a0fee2893 with identifier: 20482892 to the API
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_driver-1774681968316.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '178520b7-01ec-5e91-9dfd-979a0fee2893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AU18 ZVD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20482892',
'listing': 'auction',
'location': 'East Sussex Saint Leonards-on-sea',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 44240,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631447,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_driver-1774681862425.jpg',
'Width': 3190},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1761944,
'Height': 2503,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_driver-1774681968316.jpg',
'Width': 3337},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1541253,
'Height': 2565,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_front_passenger-1774682026068.jpg',
'Width': 3420},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041005,
'Height': 2774,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2892/20482892/exterior_rear_passenger-1774681988591.jpg',
'Width': 3698},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2531705,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2892/20482892/interior_front_seats-1774682386537.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2920309,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2892/20482892/interior_rear_seats-1774719768478.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3003955,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2892/20482892/interior_dashboard-1774772148523.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2696732,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2892/20482892/interior_boot-1774682360877.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4380308,
'Height': 4258,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2892/20482892/docs_service_history-1774719189435.jpg?ixlib=js-3.8.0&auto=format&s=b1d79fc1abc3e0ec067bac3c5475f03b',
'Width': 2832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178520b7-01ec-5e91-9dfd-979a0fee2893/178520b7-01ec-5e91-9dfd-979a0fee2893_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100016,
'Height': 482,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2892/20482892/damage_scratches-1774771963848.jpg',
'Width': 642}],
'price': 9474,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Design Hybrid VVT-i CVT',
'transmission': 'automatic',
'trim': 'Design Hybrid VVT-i CVT',
'vin': 'VNKKD3D350A422608',
'year': 2018}
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482892%27 HTTP/1.1" 200 None
2026-03-29 20:30:45 [motorway.uk] INFO: Saving data for 20482892: {'created_time': 1774816245.378117, 'last_price_update_time': 1774816245.378126, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20482892') HTTP/1.1" 204 0
2026-03-29 20:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_driver-1774630552891.jpg> (referer: None)
2026-03-29 20:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc1528b290>
2026-03-29 20:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4459%252F18634459%252Fexterior_front_driver-1774630552891.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_driver-1774630552891.jpg saved to cache
2026-03-29 20:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65881d93-46cb-5528-a8d1-f46d766c9a89
2026-03-29 20:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65881d93-46cb-5528-a8d1-f46d766c9a89, skipping ID generation
2026-03-29 20:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65881d93-46cb-5528-a8d1-f46d766c9a89 with scrape type 1
2026-03-29 20:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65881d93-46cb-5528-a8d1-f46d766c9a89 sending to next pipeline
2026-03-29 20:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 65881d93-46cb-5528-a8d1-f46d766c9a89, identifier: 18634459
2026-03-29 20:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 65881d93-46cb-5528-a8d1-f46d766c9a89 with identifier: 18634459
2026-03-29 20:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 65881d93-46cb-5528-a8d1-f46d766c9a89 with identifier: 18634459
2026-03-29 20:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 65881d93-46cb-5528-a8d1-f46d766c9a89 with identifier: 18634459 to the API
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_driver-1774630552891.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '65881d93-46cb-5528-a8d1-f46d766c9a89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK65 XBN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18634459',
'listing': 'auction',
'location': 'Gloucestershire Dursley',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 56859,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757154,
'Height': 2561,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_driver-1774630552891.jpg',
'Width': 3414},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932426,
'Height': 2548,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_front_passenger-1774630641474.jpg',
'Width': 3397},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2164831,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4459/18634459/exterior_rear_passenger-1774630591988.jpg',
'Width': 3603},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3932784,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4459/18634459/interior_front_seats-1774631434363.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3421277,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4459/18634459/interior_rear_seats-1774631438726.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3559821,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4459/18634459/interior_dashboard-1774631447491.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5144117,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4459/18634459/interior_boot-1774631490350.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65881d93-46cb-5528-a8d1-f46d766c9a89/65881d93-46cb-5528-a8d1-f46d766c9a89_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7607323,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4459/18634459/docs_service_history-1774634371327.jpg?ixlib=js-3.8.0&auto=format&s=128afc6edc8b9bccacd5a6f5be90522e',
'Width': 4032}],
'price': 7886,
'price_includes_vat': False,
'registration_date': '2015-10-17',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Bluegt',
'transmission': 'manual',
'trim': 'Bluegt',
'vin': 'WVWZZZ6RZGY076461',
'year': 2015}
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718634459%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [motorway.uk] INFO: Saving data for 18634459: {'created_time': 1774816246.10147, 'last_price_update_time': 1774816246.10148, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18634459') HTTP/1.1" 204 0
2026-03-29 20:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14729168.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2820/20382820/interior_boot-1774704143900.jpg> (referer: None)
2026-03-29 20:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00b1157a-dfda-5274-814f-41c5febf95b0 with identifier: 14729168
2026-03-29 20:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b1157a-dfda-5274-814f-41c5febf95b0 with scrape type 1
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Fexterior_front_driver-1774700099993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_driver-1774700099993.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9168%252F14729168%252Fexterior_rear_driver-1774705199148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9168/14729168/exterior_rear_driver-1774705199148.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Fexterior_front_passenger-1774700137656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_passenger-1774700137656.jpg not downloaded yet
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eab3190>
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2820%252F20382820%252Finterior_boot-1774704143900.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2820/20382820/interior_boot-1774704143900.jpg saved to cache
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Fexterior_rear_passenger-1774700123766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_rear_passenger-1774700123766.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9168%252F14729168%252Finterior_front_seats-1774705185455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9168/14729168/interior_front_seats-1774705185455.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9168%252F14729168%252Finterior_rear_seats-1774700731911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9168/14729168/interior_rear_seats-1774700731911.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9168%252F14729168%252Finterior_dashboard-1774705172779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9168/14729168/interior_dashboard-1774705172779.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Finstrument_cluster-1774700964128.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/instrument_cluster-1774700964128.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9168%252F14729168%252Finterior_boot-1774700806232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9168/14729168/interior_boot-1774700806232.jpg not downloaded yet
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9168%252F14729168%252Fdocs_service_history-1774705089406.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a4c1ca4220de0b053f47198b4388d1f%27 HTTP/1.1" 200 None
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9168/14729168/docs_service_history-1774705089406.jpg?ixlib=js-3.8.0&auto=format&s=6a4c1ca4220de0b053f47198b4388d1f not downloaded yet
2026-03-29 20:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_passenger-1774703221800.jpg> (referer: None)
2026-03-29 20:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9168/14729168/docs_service_history-1774705089406.jpg?ixlib=js-3.8.0&auto=format&s=6a4c1ca4220de0b053f47198b4388d1f> (referer: None)
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cefc590>
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_rear_passenger-1774703221800.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_passenger-1774703221800.jpg saved to cache
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2820/20382820/interior_front_seats-1774703471504.jpg> (referer: None)
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf07e10>
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9168%252F14729168%252Fdocs_service_history-1774705089406.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a4c1ca4220de0b053f47198b4388d1f') HTTP/1.1" 204 0
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9168/14729168/docs_service_history-1774705089406.jpg?ixlib=js-3.8.0&auto=format&s=6a4c1ca4220de0b053f47198b4388d1f saved to cache
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071fd0>
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2820%252F20382820%252Finterior_front_seats-1774703471504.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2820/20382820/interior_front_seats-1774703471504.jpg saved to cache
2026-03-29 20:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9168/14729168/interior_boot-1774700806232.jpg> (referer: None)
2026-03-29 20:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9168/14729168/instrument_cluster-1774700964128.jpg> (referer: None)
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cefe910>
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9168%252F14729168%252Finterior_boot-1774700806232.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9168/14729168/interior_boot-1774700806232.jpg saved to cache
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071190>
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Finstrument_cluster-1774700964128.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/instrument_cluster-1774700964128.jpg saved to cache
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9168/14729168/interior_dashboard-1774705172779.jpg> (referer: None)
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7d0110>
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9168%252F14729168%252Finterior_dashboard-1774705172779.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9168/14729168/interior_dashboard-1774705172779.jpg saved to cache
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9168/14729168/interior_rear_seats-1774700731911.jpg> (referer: None)
2026-03-29 20:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9168/14729168/interior_front_seats-1774705185455.jpg> (referer: None)
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e90a0d0>
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9168%252F14729168%252Finterior_rear_seats-1774700731911.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9168/14729168/interior_rear_seats-1774700731911.jpg saved to cache
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cefe4d0>
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9168%252F14729168%252Finterior_front_seats-1774705185455.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9168/14729168/interior_front_seats-1774705185455.jpg saved to cache
2026-03-29 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_rear_passenger-1774700123766.jpg> (referer: None)
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19988748.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05f190>
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Fexterior_rear_passenger-1774700123766.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_rear_passenger-1774700123766.jpg saved to cache
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077999e5-37f9-5585-b32f-aa5ba8266724 with identifier: 19988748
2026-03-29 20:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077999e5-37f9-5585-b32f-aa5ba8266724 with scrape type 1
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_front_driver-1772033240661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_driver-1772033240661.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_rear_driver-1772033212332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_driver-1772033212332.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_front_passenger-1772033208025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_passenger-1772033208025.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_rear_passenger-1772033278889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_passenger-1772033278889.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finterior_front_seats-1772033852393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/interior_front_seats-1772033852393.jpg not downloaded yet
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9168/14729168/exterior_rear_driver-1774705199148.jpg> (referer: None)
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finterior_rear_seats-1772033866845.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/interior_rear_seats-1772033866845.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Finterior_dashboard-1772033897292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/interior_dashboard-1772033897292.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finstrument_cluster-1772033627005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/instrument_cluster-1772033627005.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finterior_boot-1772033875053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/interior_boot-1772033875053.jpg not downloaded yet
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8748%252F19988748%252Fdocs_service_history-1774711419286-3.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D082573e2b3109e6ce6da3227244c0230%27 HTTP/1.1" 200 None
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8748/19988748/docs_service_history-1774711419286-3.jpeg?ixlib=js-3.8.0&auto=format&s=082573e2b3109e6ce6da3227244c0230 not downloaded yet
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_passenger-1774700137656.jpg> (referer: None)
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_driver-1774700099993.jpg> (referer: None)
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7160d0>
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9168%252F14729168%252Fexterior_rear_driver-1774705199148.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9168/14729168/exterior_rear_driver-1774705199148.jpg saved to cache
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8748/19988748/docs_service_history-1774711419286-3.jpeg?ixlib=js-3.8.0&auto=format&s=082573e2b3109e6ce6da3227244c0230> (referer: None)
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7178d0>
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Fexterior_front_passenger-1774700137656.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_passenger-1774700137656.jpg saved to cache
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d025190>
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9168%252F14729168%252Fexterior_front_driver-1774700099993.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_driver-1774700099993.jpg saved to cache
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00b1157a-dfda-5274-814f-41c5febf95b0
2026-03-29 20:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00b1157a-dfda-5274-814f-41c5febf95b0, skipping ID generation
2026-03-29 20:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00b1157a-dfda-5274-814f-41c5febf95b0 with scrape type 1
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00b1157a-dfda-5274-814f-41c5febf95b0 sending to next pipeline
2026-03-29 20:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 00b1157a-dfda-5274-814f-41c5febf95b0, identifier: 14729168
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e080cd0>
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8748%252F19988748%252Fdocs_service_history-1774711419286-3.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D082573e2b3109e6ce6da3227244c0230') HTTP/1.1" 204 0
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8748/19988748/docs_service_history-1774711419286-3.jpeg?ixlib=js-3.8.0&auto=format&s=082573e2b3109e6ce6da3227244c0230 saved to cache
2026-03-29 20:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 00b1157a-dfda-5274-814f-41c5febf95b0 with identifier: 14729168
2026-03-29 20:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 00b1157a-dfda-5274-814f-41c5febf95b0 with identifier: 14729168
2026-03-29 20:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 00b1157a-dfda-5274-814f-41c5febf95b0 with identifier: 14729168 to the API
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_driver-1774700099993.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '00b1157a-dfda-5274-814f-41c5febf95b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WR18 WKE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14729168',
'listing': 'auction',
'location': 'Kent Sevenoaks',
'make': 'Fiat',
'model': '500',
'odometer': 75294,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1000427,
'Height': 1949,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_driver-1774700099993.jpg',
'Width': 2599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1263955,
'Height': 2000,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9168/14729168/exterior_rear_driver-1774705199148.jpg',
'Width': 2667},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1046201,
'Height': 1913,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_front_passenger-1774700137656.jpg',
'Width': 2551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 998822,
'Height': 1978,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9168/14729168/exterior_rear_passenger-1774700123766.jpg',
'Width': 2637},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408229,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9168/14729168/interior_front_seats-1774705185455.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4092440,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9168/14729168/interior_rear_seats-1774700731911.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928227,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9168/14729168/interior_dashboard-1774705172779.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1861870,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9168/14729168/instrument_cluster-1774700964128.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2923778,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9168/14729168/interior_boot-1774700806232.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00b1157a-dfda-5274-814f-41c5febf95b0/00b1157a-dfda-5274-814f-41c5febf95b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423837,
'Height': 1546,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9168/14729168/docs_service_history-1774705089406.jpg?ixlib=js-3.8.0&auto=format&s=6a4c1ca4220de0b053f47198b4388d1f',
'Width': 2061}],
'price': 3716,
'price_includes_vat': False,
'registration_date': '2018-04-17',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'vin': 'ZFA3120000J980817',
'year': 2018}
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714729168%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [motorway.uk] INFO: Saving data for 14729168: {'created_time': 1774816249.391242, 'last_price_update_time': 1774816249.391251, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14729168') HTTP/1.1" 204 0
2026-03-29 20:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13203122.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_passenger-1772033278889.jpg> (referer: None)
2026-03-29 20:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8748/19988748/instrument_cluster-1772033627005.jpg> (referer: None)
2026-03-29 20:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8748/19988748/interior_boot-1772033875053.jpg> (referer: None)
2026-03-29 20:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3e66f9-9a65-5647-bf99-89ca90751d51 with identifier: 13203122
2026-03-29 20:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3e66f9-9a65-5647-bf99-89ca90751d51 with scrape type 1
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_front_driver-1774704410342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_driver-1774704410342.jpg not downloaded yet
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_rear_driver-1774704428989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_driver-1774704428989.jpg not downloaded yet
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_front_passenger-1774704444415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_passenger-1774704444415.jpg not downloaded yet
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce41490>
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_rear_passenger-1772033278889.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_passenger-1772033278889.jpg saved to cache
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xc0'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-G9750\x00'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xd0'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 191 - value: b'G9750ZHU8HXE1\x00'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:25 15:32:50\x00'
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2ebd0>
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finstrument_cluster-1772033627005.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/instrument_cluster-1772033627005.jpg saved to cache
2026-03-29 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xc0'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-G9750\x00'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xd0'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 191 - value: b'G9750ZHU8HXE1\x00'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:49 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:25 15:34:49\x00'
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2db50>
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finterior_boot-1772033875053.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/interior_boot-1772033875053.jpg saved to cache
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_rear_passenger-1774704434410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_passenger-1774704434410.jpg not downloaded yet
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488936.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3122%252F13203122%252Finterior_front_seats-1774704724762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3122/13203122/interior_front_seats-1774704724762.jpg not downloaded yet
2026-03-29 20:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3122%252F13203122%252Finterior_rear_seats-1774704823736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3122/13203122/interior_rear_seats-1774704823736.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Finterior_dashboard-1774704758632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/interior_dashboard-1774704758632.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Finstrument_cluster-1774704828076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/instrument_cluster-1774704828076.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3122%252F13203122%252Finterior_boot-1774704767732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3122/13203122/interior_boot-1774704767732.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3122%252F13203122%252Fdocs_service_history-1774705488531.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D557cdad6ede6f3b7755348a11d24e589%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3122/13203122/docs_service_history-1774705488531.jpg?ixlib=js-3.8.0&auto=format&s=557cdad6ede6f3b7755348a11d24e589 not downloaded yet
2026-03-29 20:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 with identifier: 20488936
2026-03-29 20:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 with scrape type 1
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_front_driver-1774712739069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_driver-1774712739069.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_rear_driver-1774712787282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_driver-1774712787282.jpg not downloaded yet
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/19988748/interior_dashboard-1772033897292.jpg> (referer: None)
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_front_passenger-1774712818387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_passenger-1774712818387.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_rear_passenger-1774712806197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_passenger-1774712806197.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8936%252F20488936%252Finterior_front_seats-1774714857439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8936/20488936/interior_front_seats-1774714857439.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8936%252F20488936%252Finterior_rear_seats-1774713102648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8936/20488936/interior_rear_seats-1774713102648.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8936%252F20488936%252Finterior_dashboard-1774714839496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8936/20488936/interior_dashboard-1774714839496.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Finstrument_cluster-1774713188512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/instrument_cluster-1774713188512.jpg not downloaded yet
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8936%252F20488936%252Finterior_boot-1774713140327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8936/20488936/interior_boot-1774713140327.jpg not downloaded yet
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2c3d0>
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Finterior_dashboard-1772033897292.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/interior_dashboard-1772033897292.jpg saved to cache
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fwheels_front_driver-1774712867920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/wheels_front_driver-1774712867920.jpg not downloaded yet
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_passenger-1774704434410.jpg> (referer: None)
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8748/19988748/interior_rear_seats-1772033866845.jpg> (referer: None)
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_passenger-1774704444415.jpg> (referer: None)
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_driver-1774704428989.jpg> (referer: None)
2026-03-29 20:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488223.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c2e10>
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_rear_passenger-1774704434410.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_passenger-1774704434410.jpg saved to cache
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xc0'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-G9750\x00'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xd0'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 191 - value: b'G9750ZHU8HXE1\x00'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:25 15:34:00\x00'
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea84250>
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finterior_rear_seats-1772033866845.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/interior_rear_seats-1772033866845.jpg saved to cache
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb6550>
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_front_passenger-1774704444415.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_passenger-1774704444415.jpg saved to cache
2026-03-29 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7399d0>
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_rear_driver-1774704428989.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_driver-1774704428989.jpg saved to cache
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743bef8a-f1e5-51f3-8696-8062e9fd58a1 with identifier: 20488223
2026-03-29 20:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1 with scrape type 1
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_front_driver-1774704010656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_driver-1774704010656.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_rear_driver-1774704016250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_driver-1774704016250.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_front_passenger-1774704014357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_passenger-1774704014357.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_rear_passenger-1774704007713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_passenger-1774704007713.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20488223%252Finterior_front_seats-1774705410875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20488223/interior_front_seats-1774705410875.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20488223%252Finterior_rear_seats-1774705408070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20488223/interior_rear_seats-1774705408070.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Finterior_dashboard-1774705489254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/interior_dashboard-1774705489254.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Finstrument_cluster-1774705532279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/instrument_cluster-1774705532279.jpg not downloaded yet
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20488223%252Finterior_boot-1774705412633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20488223/interior_boot-1774705412633.jpg not downloaded yet
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_driver-1774712787282.jpg> (referer: None)
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8223%252F20488223%252Fdocs_service_history-1774705966453.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0ccfc5aab1258cdf4b169a3d40dfc77c%27 HTTP/1.1" 200 None
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20488223/docs_service_history-1774705966453.jpg?ixlib=js-3.8.0&auto=format&s=0ccfc5aab1258cdf4b169a3d40dfc77c not downloaded yet
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8936/20488936/wheels_front_driver-1774712867920.jpg> (referer: None)
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_driver-1774704010656.jpg> (referer: None)
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8936/20488936/interior_dashboard-1774714839496.jpg> (referer: None)
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce43d10>
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_rear_driver-1774712787282.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_driver-1774712787282.jpg saved to cache
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2f750>
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fwheels_front_driver-1774712867920.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/wheels_front_driver-1774712867920.jpg saved to cache
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e909b10>
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_front_driver-1774704010656.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_driver-1774704010656.jpg saved to cache
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d787e10>
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8936%252F20488936%252Finterior_dashboard-1774714839496.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8936/20488936/interior_dashboard-1774714839496.jpg saved to cache
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20488223/docs_service_history-1774705966453.jpg?ixlib=js-3.8.0&auto=format&s=0ccfc5aab1258cdf4b169a3d40dfc77c> (referer: None)
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8936/20488936/instrument_cluster-1774713188512.jpg> (referer: None)
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20488223/instrument_cluster-1774705532279.jpg> (referer: None)
2026-03-29 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8936/20488936/interior_boot-1774713140327.jpg> (referer: None)
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec81590>
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8223%252F20488223%252Fdocs_service_history-1774705966453.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0ccfc5aab1258cdf4b169a3d40dfc77c') HTTP/1.1" 204 0
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20488223/docs_service_history-1774705966453.jpg?ixlib=js-3.8.0&auto=format&s=0ccfc5aab1258cdf4b169a3d40dfc77c saved to cache
2026-03-29 20:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d291f90>
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Finstrument_cluster-1774713188512.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/instrument_cluster-1774713188512.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e90a990>
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Finstrument_cluster-1774705532279.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/instrument_cluster-1774705532279.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2d550>
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8936%252F20488936%252Finterior_boot-1774713140327.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8936/20488936/interior_boot-1774713140327.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8223/20488223/interior_front_seats-1774705410875.jpg> (referer: None)
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20488223/interior_dashboard-1774705489254.jpg> (referer: None)
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8223/20488223/interior_boot-1774705412633.jpg> (referer: None)
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8223/20488223/interior_rear_seats-1774705408070.jpg> (referer: None)
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f04410>
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20488223%252Finterior_front_seats-1774705410875.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20488223/interior_front_seats-1774705410875.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d798d90>
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Finterior_dashboard-1774705489254.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/interior_dashboard-1774705489254.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c106d0>
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20488223%252Finterior_boot-1774705412633.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20488223/interior_boot-1774705412633.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d786cd0>
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8223%252F20488223%252Finterior_rear_seats-1774705408070.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8223/20488223/interior_rear_seats-1774705408070.jpg saved to cache
2026-03-29 20:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_passenger-1774704014357.jpg> (referer: None)
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_passenger-1774704007713.jpg> (referer: None)
2026-03-29 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_driver-1774704016250.jpg> (referer: None)
2026-03-29 20:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05c650>
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_front_passenger-1774704014357.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_passenger-1774704014357.jpg saved to cache
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e065b50>
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_rear_passenger-1774704007713.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_passenger-1774704007713.jpg saved to cache
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d79a010>
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8223%252F20488223%252Fexterior_rear_driver-1774704016250.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_driver-1774704016250.jpg saved to cache
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1
2026-03-29 20:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 743bef8a-f1e5-51f3-8696-8062e9fd58a1, skipping ID generation
2026-03-29 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1 with scrape type 1
2026-03-29 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 743bef8a-f1e5-51f3-8696-8062e9fd58a1 sending to next pipeline
2026-03-29 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 743bef8a-f1e5-51f3-8696-8062e9fd58a1, identifier: 20488223
2026-03-29 20:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 743bef8a-f1e5-51f3-8696-8062e9fd58a1 with identifier: 20488223
2026-03-29 20:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 743bef8a-f1e5-51f3-8696-8062e9fd58a1 with identifier: 20488223
2026-03-29 20:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 743bef8a-f1e5-51f3-8696-8062e9fd58a1 with identifier: 20488223 to the API
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_driver-1774704016250.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '743bef8a-f1e5-51f3-8696-8062e9fd58a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CA68 NKH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488223',
'listing': 'auction',
'location': 'West Midlands Stourbridge',
'make': 'Toyota',
'model': 'Auris',
'odometer': 84446,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623220,
'Height': 2605,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_driver-1774704010656.jpg',
'Width': 3473},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1510433,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_driver-1774704016250.jpg',
'Width': 3803},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1147726,
'Height': 2725,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_front_passenger-1774704014357.jpg',
'Width': 3633},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1359811,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20488223/exterior_rear_passenger-1774704007713.jpg',
'Width': 3327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2793242,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8223/20488223/interior_front_seats-1774705410875.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3092965,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8223/20488223/interior_rear_seats-1774705408070.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2369378,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20488223/interior_dashboard-1774705489254.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607482,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8223/20488223/instrument_cluster-1774705532279.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2246715,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8223/20488223/interior_boot-1774705412633.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743bef8a-f1e5-51f3-8696-8062e9fd58a1/743bef8a-f1e5-51f3-8696-8062e9fd58a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1715961,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8223/20488223/docs_service_history-1774705966453.jpg?ixlib=js-3.8.0&auto=format&s=0ccfc5aab1258cdf4b169a3d40dfc77c',
'Width': 3840}],
'price': 8466,
'price_includes_vat': False,
'registration_date': '2018-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Auris Design HEV VVT-i CVT',
'transmission': 'automatic',
'trim': 'Design HEV VVT-i CVT',
'vin': 'SB1MS3JEX0E447126',
'year': 2018}
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488223%27 HTTP/1.1" 200 None
2026-03-29 20:30:53 [motorway.uk] INFO: Saving data for 20488223: {'created_time': 1774816253.922298, 'last_price_update_time': 1774816253.922309, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488223') HTTP/1.1" 204 0
2026-03-29 20:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_passenger-1774712818387.jpg> (referer: None)
2026-03-29 20:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_passenger-1774712806197.jpg> (referer: None)
2026-03-29 20:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8936/20488936/interior_front_seats-1774714857439.jpg> (referer: None)
2026-03-29 20:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8936/20488936/interior_rear_seats-1774713102648.jpg> (referer: None)
2026-03-29 20:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_driver-1774712739069.jpg> (referer: None)
2026-03-29 20:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3122/13203122/docs_service_history-1774705488531.jpg?ixlib=js-3.8.0&auto=format&s=557cdad6ede6f3b7755348a11d24e589> (referer: None)
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0eb250>
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_front_passenger-1774712818387.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_passenger-1774712818387.jpg saved to cache
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e067310>
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_rear_passenger-1774712806197.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_passenger-1774712806197.jpg saved to cache
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95fdd0>
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8936%252F20488936%252Finterior_front_seats-1774714857439.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8936/20488936/interior_front_seats-1774714857439.jpg saved to cache
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d271ad0>
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8936%252F20488936%252Finterior_rear_seats-1774713102648.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8936/20488936/interior_rear_seats-1774713102648.jpg saved to cache
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95c910>
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8936%252F20488936%252Fexterior_front_driver-1774712739069.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_driver-1774712739069.jpg saved to cache
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517
2026-03-29 20:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3ef19d0-dcfb-502d-83e9-7caa3cdf8517, skipping ID generation
2026-03-29 20:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 with scrape type 1
2026-03-29 20:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 sending to next pipeline
2026-03-29 20:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b3ef19d0-dcfb-502d-83e9-7caa3cdf8517, identifier: 20488936
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e067b50>
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3122%252F13203122%252Fdocs_service_history-1774705488531.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D557cdad6ede6f3b7755348a11d24e589') HTTP/1.1" 204 0
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3122/13203122/docs_service_history-1774705488531.jpg?ixlib=js-3.8.0&auto=format&s=557cdad6ede6f3b7755348a11d24e589 saved to cache
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 with identifier: 20488936
2026-03-29 20:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 with identifier: 20488936
2026-03-29 20:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b3ef19d0-dcfb-502d-83e9-7caa3cdf8517 with identifier: 20488936 to the API
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_driver-1774712739069.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b3ef19d0-dcfb-502d-83e9-7caa3cdf8517',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AU25 WWP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488936',
'listing': 'auction',
'location': 'Suffolk Halesworth',
'make': 'MG',
'model': '3',
'odometer': 7000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2589046,
'Height': 3020,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_driver-1774712739069.jpg',
'Width': 4027},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765110,
'Height': 2667,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_driver-1774712787282.jpg',
'Width': 3556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203189,
'Height': 2987,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_front_passenger-1774712818387.jpg',
'Width': 3982},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2275273,
'Height': 2976,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8936/20488936/exterior_rear_passenger-1774712806197.jpg',
'Width': 3968},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2752011,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8936/20488936/interior_front_seats-1774714857439.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507058,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8936/20488936/interior_rear_seats-1774713102648.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2208025,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8936/20488936/interior_dashboard-1774714839496.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2002933,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8936/20488936/instrument_cluster-1774713188512.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3158381,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8936/20488936/interior_boot-1774713140327.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef19d0-dcfb-502d-83e9-7caa3cdf8517/b3ef19d0-dcfb-502d-83e9-7caa3cdf8517_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2025231,
'Height': 2890,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8936/20488936/wheels_front_driver-1774712867920.jpg',
'Width': 3853}],
'price': 13550,
'price_includes_vat': False,
'registration_date': '2025-03-03',
'seats_number': None,
'seller_name': None,
'title': 'MG 3 Trophy HEV Auto',
'transmission': 'automatic',
'trim': 'Trophy HEV Auto',
'vin': 'LSJWP4396RZ231175',
'year': 2025}
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488936%27 HTTP/1.1" 200 None
2026-03-29 20:30:55 [motorway.uk] INFO: Saving data for 20488936: {'created_time': 1774816255.406301, 'last_price_update_time': 1774816255.406312, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488936') HTTP/1.1" 204 0
2026-03-29 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3122/13203122/interior_boot-1774704767732.jpg> (referer: None)
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d08efd0>
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3122%252F13203122%252Finterior_boot-1774704767732.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3122/13203122/interior_boot-1774704767732.jpg saved to cache
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_driver-1774704410342.jpg> (referer: None)
2026-03-29 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3122/13203122/instrument_cluster-1774704828076.jpg> (referer: None)
2026-03-29 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8748/19988748/interior_front_seats-1772033852393.jpg> (referer: None)
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e977650>
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Fexterior_front_driver-1774704410342.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_driver-1774704410342.jpg saved to cache
2026-03-29 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecec50>
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Finstrument_cluster-1774704828076.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/instrument_cluster-1774704828076.jpg saved to cache
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xc0'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-G9750\x00'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xd0'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 191 - value: b'G9750ZHU8HXE1\x00'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:25 15:33:31\x00'
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e977510>
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8748%252F19988748%252Finterior_front_seats-1772033852393.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8748/19988748/interior_front_seats-1772033852393.jpg saved to cache
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_passenger-1772033208025.jpg> (referer: None)
2026-03-29 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_driver-1772033212332.jpg> (referer: None)
2026-03-29 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3122/13203122/interior_dashboard-1774704758632.jpg> (referer: None)
2026-03-29 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3122/13203122/interior_front_seats-1774704724762.jpg> (referer: None)
2026-03-29 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3122/13203122/interior_rear_seats-1774704823736.jpg> (referer: None)
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28b190>
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_front_passenger-1772033208025.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_passenger-1772033208025.jpg saved to cache
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7d1cd0>
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_rear_driver-1772033212332.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_driver-1772033212332.jpg saved to cache
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_driver-1772033240661.jpg> (referer: None)
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0caa56d0>
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3122%252F13203122%252Finterior_dashboard-1774704758632.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3122/13203122/interior_dashboard-1774704758632.jpg saved to cache
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d2210>
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3122%252F13203122%252Finterior_front_seats-1774704724762.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3122/13203122/interior_front_seats-1774704724762.jpg saved to cache
2026-03-29 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2b3850>
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3122%252F13203122%252Finterior_rear_seats-1774704823736.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3122/13203122/interior_rear_seats-1774704823736.jpg saved to cache
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b3e66f9-9a65-5647-bf99-89ca90751d51
2026-03-29 20:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b3e66f9-9a65-5647-bf99-89ca90751d51, skipping ID generation
2026-03-29 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3e66f9-9a65-5647-bf99-89ca90751d51 with scrape type 1
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b3e66f9-9a65-5647-bf99-89ca90751d51 sending to next pipeline
2026-03-29 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7b3e66f9-9a65-5647-bf99-89ca90751d51, identifier: 13203122
2026-03-29 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7b3e66f9-9a65-5647-bf99-89ca90751d51 with identifier: 13203122
2026-03-29 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7b3e66f9-9a65-5647-bf99-89ca90751d51 with identifier: 13203122
2026-03-29 20:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7b3e66f9-9a65-5647-bf99-89ca90751d51 with identifier: 13203122 to the API
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3122/13203122/interior_rear_seats-1774704823736.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7b3e66f9-9a65-5647-bf99-89ca90751d51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK17 NZF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13203122',
'listing': 'auction',
'location': 'Wiltshire Malmesbury',
'make': 'Audi',
'model': 'A5',
'odometer': 75570,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538409,
'Height': 2312,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_driver-1774704410342.jpg',
'Width': 3083},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1798200,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_driver-1774704428989.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1544009,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_front_passenger-1774704444415.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2145012,
'Height': 2879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3122/13203122/exterior_rear_passenger-1774704434410.jpg',
'Width': 3838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3407541,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3122/13203122/interior_front_seats-1774704724762.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3909351,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3122/13203122/interior_rear_seats-1774704823736.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3644078,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3122/13203122/interior_dashboard-1774704758632.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2598835,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3122/13203122/instrument_cluster-1774704828076.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4084230,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3122/13203122/interior_boot-1774704767732.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3e66f9-9a65-5647-bf99-89ca90751d51/7b3e66f9-9a65-5647-bf99-89ca90751d51_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4375910,
'Height': 3666,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3122/13203122/docs_service_history-1774705488531.jpg?ixlib=js-3.8.0&auto=format&s=557cdad6ede6f3b7755348a11d24e589',
'Width': 2467}],
'price': 11892,
'price_includes_vat': False,
'registration_date': '2017-03-22',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S Line TFSI Quattro S-A',
'transmission': 'automatic',
'trim': 'S Line TFSI Quattro S-A',
'vin': 'WAUZZZF51HA006011',
'year': 2017}
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713203122%27 HTTP/1.1" 200 None
2026-03-29 20:30:57 [motorway.uk] INFO: Saving data for 13203122: {'created_time': 1774816257.484533, 'last_price_update_time': 1774816257.484543, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13203122') HTTP/1.1" 204 0
2026-03-29 20:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d027050>
2026-03-29 20:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8748%252F19988748%252Fexterior_front_driver-1772033240661.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_driver-1772033240661.jpg saved to cache
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 077999e5-37f9-5585-b32f-aa5ba8266724
2026-03-29 20:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 077999e5-37f9-5585-b32f-aa5ba8266724, skipping ID generation
2026-03-29 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077999e5-37f9-5585-b32f-aa5ba8266724 with scrape type 1
2026-03-29 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 077999e5-37f9-5585-b32f-aa5ba8266724 sending to next pipeline
2026-03-29 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 077999e5-37f9-5585-b32f-aa5ba8266724, identifier: 19988748
2026-03-29 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 077999e5-37f9-5585-b32f-aa5ba8266724 with identifier: 19988748
2026-03-29 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 077999e5-37f9-5585-b32f-aa5ba8266724 with identifier: 19988748
2026-03-29 20:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 077999e5-37f9-5585-b32f-aa5ba8266724 with identifier: 19988748 to the API
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_driver-1772033240661.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '077999e5-37f9-5585-b32f-aa5ba8266724',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LV17 UHO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19988748',
'listing': 'auction',
'location': 'Kent Sevenoaks',
'make': 'Audi',
'model': 'A3',
'odometer': 83000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1150477,
'Height': 2090,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_driver-1772033240661.jpg',
'Width': 2787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261897,
'Height': 2253,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_driver-1772033212332.jpg',
'Width': 3004},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1223562,
'Height': 2066,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_front_passenger-1772033208025.jpg',
'Width': 2754},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614187,
'Height': 2225,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8748/19988748/exterior_rear_passenger-1772033278889.jpg',
'Width': 2967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5964568,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8748/19988748/interior_front_seats-1772033852393.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6503203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8748/19988748/interior_rear_seats-1772033866845.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261901,
'Height': 4032,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8748/19988748/interior_dashboard-1772033897292.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4586976,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8748/19988748/instrument_cluster-1772033627005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5699990,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8748/19988748/interior_boot-1772033875053.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077999e5-37f9-5585-b32f-aa5ba8266724/077999e5-37f9-5585-b32f-aa5ba8266724_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66711,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8748/19988748/docs_service_history-1774711419286-3.jpeg?ixlib=js-3.8.0&auto=format&s=082573e2b3109e6ce6da3227244c0230',
'Width': 892}],
'price': 10575,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line Black Edition TDI SA',
'transmission': 'automatic',
'trim': 'S Line Black Edition TDI SA',
'vin': 'WAUZZZ8V1HA121530',
'year': 2017}
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719988748%27 HTTP/1.1" 200 None
2026-03-29 20:30:58 [motorway.uk] INFO: Saving data for 19988748: {'created_time': 1774816258.077793, 'last_price_update_time': 1774816258.077804, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19988748') HTTP/1.1" 204 0
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_driver-1774703209807.jpg> (referer: None)
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_passenger-1774703237024.jpg> (referer: None)
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d9350>
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_rear_driver-1774703209807.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_driver-1774703209807.jpg saved to cache
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec1f010>
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_front_passenger-1774703237024.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_passenger-1774703237024.jpg saved to cache
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4090/18664090/interior_front_seats-1774711382402.jpeg> (referer: None)
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9908/10709908/interior_boot-1774182792444.jpg> (referer: None)
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_rear_passenger-1774711144568.jpeg> (referer: None)
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_driver-1774703868893.jpg> (referer: None)
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_front_passenger-1774711129082.jpeg> (referer: None)
2026-03-29 20:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_rear_driver-modified-1774717612259.jpeg> (referer: None)
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004\\a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02X\x19\x004Q\xcf\x00\x00\x00\x00'
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d8b10>
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4090%252F18664090%252Finterior_front_seats-1774711382402.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4090/18664090/interior_front_seats-1774711382402.jpeg saved to cache
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:30:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1e10>
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9908%252F10709908%252Finterior_boot-1774182792444.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9908/10709908/interior_boot-1774182792444.jpg saved to cache
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9779d0>
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Fexterior_rear_passenger-1774711144568.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_rear_passenger-1774711144568.jpeg saved to cache
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f05790>
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2820%252F20382820%252Fexterior_front_driver-1774703868893.jpg') HTTP/1.1" 204 0
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_driver-1774703868893.jpg saved to cache
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703
2026-03-29 20:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fd8ec6f-95fe-5d7f-9845-347a2851a703, skipping ID generation
2026-03-29 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703 with scrape type 1
2026-03-29 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fd8ec6f-95fe-5d7f-9845-347a2851a703 sending to next pipeline
2026-03-29 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4fd8ec6f-95fe-5d7f-9845-347a2851a703, identifier: 20382820
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c3f8450>
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4090%252F18664090%252Fexterior_front_passenger-1774711129082.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_front_passenger-1774711129082.jpeg saved to cache
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d770fd0>
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4090%252F18664090%252F18664090-exterior_rear_driver-modified-1774717612259.jpeg') HTTP/1.1" 204 0
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_rear_driver-modified-1774717612259.jpeg saved to cache
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019
2026-03-29 20:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cdb0f00-716e-5ed2-8037-f2a7bb811019, skipping ID generation
2026-03-29 20:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019 with scrape type 1
2026-03-29 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cdb0f00-716e-5ed2-8037-f2a7bb811019 sending to next pipeline
2026-03-29 20:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5cdb0f00-716e-5ed2-8037-f2a7bb811019, identifier: 18664090
2026-03-29 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4fd8ec6f-95fe-5d7f-9845-347a2851a703 with identifier: 20382820
2026-03-29 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4fd8ec6f-95fe-5d7f-9845-347a2851a703 with identifier: 20382820
2026-03-29 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4fd8ec6f-95fe-5d7f-9845-347a2851a703 with identifier: 20382820 to the API
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_driver-1774703868893.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4fd8ec6f-95fe-5d7f-9845-347a2851a703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV20 WCA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20382820',
'listing': 'auction',
'location': 'Lincolnshire Lincoln',
'make': 'Vauxhall',
'model': 'Vivaro',
'odometer': 87700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1951834,
'Height': 2786,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_driver-1774703868893.jpg',
'Width': 3714},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 948163,
'Height': 1994,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_driver-1774703209807.jpg',
'Width': 2659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387648,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_front_passenger-1774703237024.jpg',
'Width': 3299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1011871,
'Height': 2217,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2820/20382820/exterior_rear_passenger-1774703221800.jpg',
'Width': 2956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3597705,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2820/20382820/interior_front_seats-1774703471504.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2565099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2820/20382820/20382820-interior_dashboard-modified-1774704440676.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1094061,
'Height': 2013,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2820/20382820/interior_boot-1774704143900.jpg',
'Width': 2685},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2838627,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2820/20382820/damage_windscreen-1774703285157.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 905640,
'Height': 1996,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_front_driver-1774703311426.jpg',
'Width': 2661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fd8ec6f-95fe-5d7f-9845-347a2851a703/4fd8ec6f-95fe-5d7f-9845-347a2851a703_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1412734,
'Height': 2391,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2820/20382820/wheels_rear_driver-1774703333340.jpg',
'Width': 3188}],
'price': 7483,
'price_includes_vat': False,
'registration_date': '2020-05-29',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Vivaro 2900 Sportive S/S',
'transmission': 'manual',
'trim': '2900 Sportive S/S',
'vin': 'VXEVBYHRKL7022228',
'year': 2020}
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382820%27 HTTP/1.1" 200 None
2026-03-29 20:30:59 [motorway.uk] INFO: Saving data for 20382820: {'created_time': 1774816259.721049, 'last_price_update_time': 1774816259.721063, 'auction_closing_time': 1774884600.0}
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20382820') HTTP/1.1" 204 0
2026-03-29 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5cdb0f00-716e-5ed2-8037-f2a7bb811019 with identifier: 18664090
2026-03-29 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5cdb0f00-716e-5ed2-8037-f2a7bb811019 with identifier: 18664090
2026-03-29 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5cdb0f00-716e-5ed2-8037-f2a7bb811019 with identifier: 18664090 to the API
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_rear_driver-modified-1774717612259.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5cdb0f00-716e-5ed2-8037-f2a7bb811019',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AO68 LDF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18664090',
'listing': 'auction',
'location': 'Greater Manchester Stockport',
'make': 'Audi',
'model': 'A6',
'odometer': 49790,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4134436,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_front_driver-modified-1774718719166.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3006896,
'Height': 2959,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4090/18664090/18664090-exterior_rear_driver-modified-1774717612259.jpeg',
'Width': 3945},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1415342,
'Height': 2177,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_front_passenger-1774711129082.jpeg',
'Width': 2903},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630200,
'Height': 2723,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4090/18664090/exterior_rear_passenger-1774711144568.jpeg',
'Width': 3630},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3585146,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4090/18664090/interior_front_seats-1774711382402.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3494300,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4090/18664090/interior_rear_seats-1774711261753.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1579550,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4090/18664090/interior_dashboard-1774711288622.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 874067,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4090/18664090/instrument_cluster-1774711364025.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3101452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4090/18664090/interior_boot-1774711294817.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdb0f00-716e-5ed2-8037-f2a7bb811019/5cdb0f00-716e-5ed2-8037-f2a7bb811019_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3640720,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4090/18664090/docs_service_history-1774712478616.jpeg?ixlib=js-3.8.0&auto=format&s=706ceca0d9ea5265c9b4570731fad0a1',
'Width': 4032}],
'price': 18131,
'price_includes_vat': False,
'registration_date': '2018-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi A6 S Line 50 TDI Quattro S-A',
'transmission': 'automatic',
'trim': 'S Line 50 TDI Quattro S-A',
'vin': 'WAUZZZF26KN009038',
'year': 2018}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718664090%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [motorway.uk] INFO: Saving data for 18664090: {'created_time': 1774816260.137345, 'last_price_update_time': 1774816260.137358, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18664090') HTTP/1.1" 204 0
2026-03-29 20:31:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.212(s), this was the 1st time calling it.
2026-03-29 20:31:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.504015307197424 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9908/10709908/instrument_cluster-1774182544411.jpg> (referer: None)
2026-03-29 20:31:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cedf190>
2026-03-29 20:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Finstrument_cluster-1774182544411.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/instrument_cluster-1774182544411.jpg saved to cache
2026-03-29 20:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20434695.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_passenger-1774181954117.jpg> (referer: None)
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_driver-1774181858563.jpg> (referer: None)
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9908/10709908/interior_dashboard-1774182500604.jpg> (referer: None)
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9908/10709908/interior_rear_seats-1774182460988.jpg> (referer: None)
2026-03-29 20:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_passenger-1774181921752.jpg> (referer: None)
2026-03-29 20:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4335c95-b46d-53f4-afa3-7b909eeb1a4b with identifier: 20434695
2026-03-29 20:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4335c95-b46d-53f4-afa3-7b909eeb1a4b with scrape type 2
2026-03-29 20:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4335c95-b46d-53f4-afa3-7b909eeb1a4b with scrape type 2
2026-03-29 20:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e4335c95-b46d-53f4-afa3-7b909eeb1a4b, identifier: 20434695
2026-03-29 20:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e4335c95-b46d-53f4-afa3-7b909eeb1a4b with identifier: 20434695
2026-03-29 20:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e4335c95-b46d-53f4-afa3-7b909eeb1a4b with identifier: 20434695
2026-03-29 20:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e4335c95-b46d-53f4-afa3-7b909eeb1a4b with identifier: 20434695 to the API
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20434695.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e4335c95-b46d-53f4-afa3-7b909eeb1a4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB71 OSE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20434695',
'listing': 'auction',
'location': 'Worcestershire Droitwich',
'make': 'Fiat',
'model': '500',
'odometer': 2193,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 8900,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 HEY Google MHEV',
'transmission': 'manual',
'trim': 'HEY Google MHEV',
'vin': 'ZFACF1DJ5NJF80877',
'year': 2022}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720434695%27 HTTP/1.1" 200 None
2026-03-29 20:31:00 [motorway.uk] INFO: Saving data for 20434695: {'auction_closing_time': 1774884600.0, 'created_time': 1774470881.795658, 'last_price_update_time': 1774816260.977012}
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20434695') HTTP/1.1" 204 0
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec92710>
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_front_passenger-1774181954117.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_passenger-1774181954117.jpg saved to cache
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58d9d0>
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_rear_driver-1774181858563.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_driver-1774181858563.jpg saved to cache
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b7350>
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Finterior_dashboard-1774182500604.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/interior_dashboard-1774182500604.jpg saved to cache
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b5110>
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9908%252F10709908%252Finterior_rear_seats-1774182460988.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9908/10709908/interior_rear_seats-1774182460988.jpg saved to cache
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07fa50>
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9908%252F10709908%252Fexterior_rear_passenger-1774181921752.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_passenger-1774181921752.jpg saved to cache
2026-03-29 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9908/10709908/interior_front_seats-1774182780280.jpg> (referer: None)
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbb6950>
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9908%252F10709908%252Finterior_front_seats-1774182780280.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9908/10709908/interior_front_seats-1774182780280.jpg saved to cache
2026-03-29 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3
2026-03-29 20:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3, skipping ID generation
2026-03-29 20:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 with scrape type 1
2026-03-29 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 sending to next pipeline
2026-03-29 20:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3, identifier: 10709908
2026-03-29 20:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 with identifier: 10709908
2026-03-29 20:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 with identifier: 10709908
2026-03-29 20:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3 with identifier: 10709908 to the API
2026-03-29 20:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9908/10709908/interior_front_seats-1774182780280.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PO68 UXG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10709908',
'listing': 'auction',
'location': 'Warwickshire Bedworth',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 59380,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1189856,
'Height': 2484,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_driver-1774181825980.jpg',
'Width': 3312},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1746607,
'Height': 2829,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_driver-1774181858563.jpg',
'Width': 3772},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1426278,
'Height': 2792,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_front_passenger-1774181954117.jpg',
'Width': 3722},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1822173,
'Height': 2818,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9908/10709908/exterior_rear_passenger-1774181921752.jpg',
'Width': 3757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3539863,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9908/10709908/interior_front_seats-1774182780280.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3733058,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9908/10709908/interior_rear_seats-1774182460988.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2910500,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9908/10709908/interior_dashboard-1774182500604.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2885192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9908/10709908/instrument_cluster-1774182544411.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027279,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9908/10709908/interior_boot-1774182792444.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3/6aeb1a36-fff4-50f1-96ba-4e6ca333fcd3_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3589784,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9908/10709908/docs_service_history-1774716404046.jpg?ixlib=js-3.8.0&auto=format&s=a6608edbefcbefe3bbc335f39bd81dad',
'Width': 4032}],
'price': 10396,
'price_includes_vat': False,
'registration_date': '2018-11-21',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-5 SE-L NAV +',
'transmission': 'manual',
'trim': 'SE-L NAV +',
'vin': 'JMZKF6W7600768072',
'year': 2018}
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710709908%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [motorway.uk] INFO: Saving data for 10709908: {'created_time': 1774816269.340941, 'last_price_update_time': 1774816269.340951, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10709908') HTTP/1.1" 204 0
2026-03-29 20:31:09 [scrapy.extensions.logstats] INFO: Crawled 312 pages (at 16 pages/min), scraped 279 items (at 22 items/min)
2026-03-29 20:31:09 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16886677.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 with identifier: 16886677
2026-03-29 20:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 with scrape type 1
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252Fexterior_front_driver-1774702741196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_front_driver-1774702741196.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252F16886677-exterior_rear_driver-default-1774713388091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_rear_driver-default-1774713388091.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252F16886677-exterior_front_passenger-default-1774713331831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_front_passenger-default-1774713331831.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252Fexterior_rear_passenger-1774702769793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_rear_passenger-1774702769793.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6677%252F16886677%252F16886677-interior_front_seats-default-1774713304898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6677/16886677/16886677-interior_front_seats-default-1774713304898.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6677%252F16886677%252Finterior_rear_seats-1774712960042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6677/16886677/interior_rear_seats-1774712960042.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252Finterior_dashboard-1774703127058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/interior_dashboard-1774703127058.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6677%252F16886677%252F16886677-interior_boot-default-1774713434128.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6677/16886677/16886677-interior_boot-default-1774713434128.jpg not downloaded yet
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F6677%252F16886677%252Fdocs_service_history-1757348248222.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9f1c01b60e96930b3b85c3159dd8932%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248222.jpg?ixlib=js-3.8.0&auto=format&s=d9f1c01b60e96930b3b85c3159dd8932 not downloaded yet
2026-03-29 20:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_front_driver-1774702741196.jpg> (referer: None)
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F6677%252F16886677%252Fdocs_service_history-1757348248238.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbc0a1959bfeb02044ddec84722000325%27 HTTP/1.1" 200 None
2026-03-29 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248238.jpg?ixlib=js-3.8.0&auto=format&s=bc0a1959bfeb02044ddec84722000325 not downloaded yet
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edcc750>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252Fexterior_front_driver-1774702741196.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_front_driver-1774702741196.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6677/16886677/interior_rear_seats-1774712960042.jpg> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_rear_passenger-1774702769793.jpg> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_rear_driver-default-1774713388091.jpg> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248222.jpg?ixlib=js-3.8.0&auto=format&s=d9f1c01b60e96930b3b85c3159dd8932> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_front_passenger-default-1774713331831.jpg> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6677/16886677/16886677-interior_front_seats-default-1774713304898.jpg> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6677/16886677/interior_dashboard-1774703127058.jpg> (referer: None)
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:49:16\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x80\x07\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2f8d0>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6677%252F16886677%252Finterior_rear_seats-1774712960042.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6677/16886677/interior_rear_seats-1774712960042.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed90650>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252Fexterior_rear_passenger-1774702769793.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_rear_passenger-1774702769793.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d026710>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252F16886677-exterior_rear_driver-default-1774713388091.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_rear_driver-default-1774713388091.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95f950>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F6677%252F16886677%252Fdocs_service_history-1757348248222.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9f1c01b60e96930b3b85c3159dd8932') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248222.jpg?ixlib=js-3.8.0&auto=format&s=d9f1c01b60e96930b3b85c3159dd8932 saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbd1350>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252F16886677-exterior_front_passenger-default-1774713331831.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_front_passenger-default-1774713331831.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xe0\x05\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A34 5G\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A346BXXSEEZB6\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:28 15:54:09\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d025e50>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6677%252F16886677%252F16886677-interior_front_seats-default-1774713304898.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6677/16886677/16886677-interior_front_seats-default-1774713304898.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce3bb10>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6677%252F16886677%252Finterior_dashboard-1774703127058.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6677/16886677/interior_dashboard-1774703127058.jpg saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248238.jpg?ixlib=js-3.8.0&auto=format&s=bc0a1959bfeb02044ddec84722000325> (referer: None)
2026-03-29 20:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6677/16886677/16886677-interior_boot-default-1774713434128.jpg> (referer: None)
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecfd50>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F6677%252F16886677%252Fdocs_service_history-1757348248238.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbc0a1959bfeb02044ddec84722000325') HTTP/1.1" 204 0
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248238.jpg?ixlib=js-3.8.0&auto=format&s=bc0a1959bfeb02044ddec84722000325 saved to cache
2026-03-29 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'4\x07\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy A34 5G\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 180 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 196 - value: b'A346BXXSEEZB6\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 210 - value: b'2026:03:28 15:56:56\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:31:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe6\x00\x00\x00'
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0397d0>
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6677%252F16886677%252F16886677-interior_boot-default-1774713434128.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6677/16886677/16886677-interior_boot-default-1774713434128.jpg saved to cache
2026-03-29 20:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4
2026-03-29 20:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b50b8b12-b8ef-52ee-bb2b-12eb58993fd4, skipping ID generation
2026-03-29 20:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 with scrape type 1
2026-03-29 20:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 sending to next pipeline
2026-03-29 20:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b50b8b12-b8ef-52ee-bb2b-12eb58993fd4, identifier: 16886677
2026-03-29 20:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 with identifier: 16886677
2026-03-29 20:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 with identifier: 16886677
2026-03-29 20:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b50b8b12-b8ef-52ee-bb2b-12eb58993fd4 with identifier: 16886677 to the API
2026-03-29 20:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6677/16886677/16886677-interior_boot-default-1774713434128.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b50b8b12-b8ef-52ee-bb2b-12eb58993fd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BG18 GDK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16886677',
'listing': 'auction',
'location': 'Essex Halstead',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 35800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353257,
'Height': 1142,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_front_driver-1774702741196.jpg',
'Width': 1523},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280631,
'Height': 1061,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_rear_driver-default-1774713388091.jpg',
'Width': 1414},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456736,
'Height': 1718,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6677/16886677/16886677-exterior_front_passenger-default-1774713331831.jpg',
'Width': 2291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345864,
'Height': 1258,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6677/16886677/exterior_rear_passenger-1774702769793.jpg',
'Width': 1677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1212055,
'Height': 1504,
'OriginUrl': 'https://motorway-photos.imgix.net/6677/16886677/16886677-interior_front_seats-default-1774713304898.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1243342,
'Height': 1440,
'OriginUrl': 'https://motorway-photos.imgix.net/6677/16886677/interior_rear_seats-1774712960042.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413963,
'Height': 1440,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6677/16886677/interior_dashboard-1774703127058.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2412512,
'Height': 1844,
'OriginUrl': 'https://motorway-photos.imgix.net/6677/16886677/16886677-interior_boot-default-1774713434128.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166060,
'Height': 1200,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248222.jpg?ixlib=js-3.8.0&auto=format&s=d9f1c01b60e96930b3b85c3159dd8932',
'Width': 1600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50b8b12-b8ef-52ee-bb2b-12eb58993fd4/b50b8b12-b8ef-52ee-bb2b-12eb58993fd4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159907,
'Height': 1200,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/6677/16886677/docs_service_history-1757348248238.jpg?ixlib=js-3.8.0&auto=format&s=bc0a1959bfeb02044ddec84722000325',
'Width': 1600}],
'price': 8881,
'price_includes_vat': False,
'registration_date': '2018-03-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai N-Connecta DiG-T',
'transmission': 'manual',
'trim': 'N-Connecta DiG-T',
'vin': 'SJNFEAJ11U2210297',
'year': 2018}
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716886677%27 HTTP/1.1" 200 None
2026-03-29 20:31:15 [motorway.uk] INFO: Saving data for 16886677: {'created_time': 1774816275.735681, 'last_price_update_time': 1774816275.735691, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16886677') HTTP/1.1" 204 0
2026-03-29 20:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19805155.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d37f07b-f0e4-53e9-b757-c69419e9545d with identifier: 19805155
2026-03-29 20:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d37f07b-f0e4-53e9-b757-c69419e9545d with scrape type 1
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d37f07b-f0e4-53e9-b757-c69419e9545d
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5155%252F19805155%252Fexterior_front_driver-1771769507021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_front_driver-1771769507021.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5155%252F19805155%252Fexterior_rear_driver-1771769522966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_rear_driver-1771769522966.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5155%252F19805155%252Fexterior_front_passenger-1771769543260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_front_passenger-1771769543260.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5155%252F19805155%252Fexterior_rear_passenger-1771769532705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_rear_passenger-1771769532705.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5155%252F19805155%252Finterior_front_seats-1774782281363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5155/19805155/interior_front_seats-1774782281363.jpg not downloaded yet
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5155%252F19805155%252Finterior_rear_seats-1771769875255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5155/19805155/interior_rear_seats-1771769875255.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5155%252F19805155%252Finterior_dashboard-1771769901509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5155/19805155/interior_dashboard-1771769901509.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5155%252F19805155%252Finstrument_cluster-1771769840736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5155/19805155/instrument_cluster-1771769840736.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5155%252F19805155%252Finterior_boot-1771769900607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5155/19805155/interior_boot-1771769900607.jpg already downloaded
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F5155%252F19805155%252Fdocs_service_history-1771770877840.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df651f587c4054e66fd3115d4e0011951%27 HTTP/1.1" 200 None
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/5155/19805155/docs_service_history-1771770877840.jpg?ixlib=js-3.8.0&auto=format&s=f651f587c4054e66fd3115d4e0011951 already downloaded
2026-03-29 20:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5155/19805155/interior_front_seats-1774782281363.jpg> (referer: None)
2026-03-29 20:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d117550>
2026-03-29 20:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5155%252F19805155%252Finterior_front_seats-1774782281363.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5155/19805155/interior_front_seats-1774782281363.jpg saved to cache
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d37f07b-f0e4-53e9-b757-c69419e9545d
2026-03-29 20:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d37f07b-f0e4-53e9-b757-c69419e9545d, skipping ID generation
2026-03-29 20:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d37f07b-f0e4-53e9-b757-c69419e9545d with scrape type 1
2026-03-29 20:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d37f07b-f0e4-53e9-b757-c69419e9545d sending to next pipeline
2026-03-29 20:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1d37f07b-f0e4-53e9-b757-c69419e9545d, identifier: 19805155
2026-03-29 20:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1d37f07b-f0e4-53e9-b757-c69419e9545d with identifier: 19805155
2026-03-29 20:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1d37f07b-f0e4-53e9-b757-c69419e9545d with identifier: 19805155
2026-03-29 20:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1d37f07b-f0e4-53e9-b757-c69419e9545d with identifier: 19805155 to the API
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5155/19805155/interior_front_seats-1774782281363.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1d37f07b-f0e4-53e9-b757-c69419e9545d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VU64 ZPJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19805155',
'listing': 'auction',
'location': 'None Preston',
'make': 'Audi',
'model': 'A1',
'odometer': 65000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664138,
'Height': 1823,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_front_driver-1771769507021.jpg',
'Width': 2431},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 998843,
'Height': 1907,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_rear_driver-1771769522966.jpg',
'Width': 2542},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1113688,
'Height': 1918,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_front_passenger-1771769543260.jpg',
'Width': 2557},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780975,
'Height': 1704,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5155/19805155/exterior_rear_passenger-1771769532705.jpg',
'Width': 2272},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581652,
'Height': 2373,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5155/19805155/interior_front_seats-1774782281363.jpg',
'Width': 3164},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3401889,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5155/19805155/interior_rear_seats-1771769875255.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1823156,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5155/19805155/interior_dashboard-1771769901509.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3075387,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5155/19805155/instrument_cluster-1771769840736.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4332240,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5155/19805155/interior_boot-1771769900607.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d37f07b-f0e4-53e9-b757-c69419e9545d/1d37f07b-f0e4-53e9-b757-c69419e9545d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 876270,
'Height': 2774,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/5155/19805155/docs_service_history-1771770877840.jpg?ixlib=js-3.8.0&auto=format&s=f651f587c4054e66fd3115d4e0011951',
'Width': 1908}],
'price': 5460,
'price_includes_vat': False,
'registration_date': '2014-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line TFSI',
'transmission': 'manual',
'trim': 'S Line TFSI',
'vin': 'WAUZZZ8X1EB123639',
'year': 2014}
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719805155%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Saving data for 19805155: {'created_time': 1774816277.427782, 'last_price_update_time': 1774816277.427792, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19805155') HTTP/1.1" 204 0
2026-03-29 20:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1080&page=30&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20500109
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20492540
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 4255654
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20381378
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 19391206
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 12889821
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 2216003
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20466618
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466618%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 20466618: 1
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20454779
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454779%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 20454779: 1
2026-03-29 20:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20175346
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20488633
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488633%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 20488633: 1
2026-03-29 20:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20418638
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20394387
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394387%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 20394387: 1
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20484190
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20488957
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20381560
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381560%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 20381560: 1
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20490401
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 19925842
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719925842%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 19925842: 1
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20301602
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20482735
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20445456
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 17007661
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 16212102
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 3155170
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20438840
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20141953
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 18015367
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 3408584
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20257689
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20465447
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20172367
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 19146005
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 10030504
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710030504%27 HTTP/1.1" 200 None
2026-03-29 20:31:17 [motorway.uk] INFO: Scrape type for 10030504: 1
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20428748
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20494737
2026-03-29 20:31:17 [motorway.uk] INFO: Found listing with ID: 20445682
2026-03-29 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19121650.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65feb5d8-2170-56d7-9aea-51b7c3394848 with identifier: 19121650
2026-03-29 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65feb5d8-2170-56d7-9aea-51b7c3394848 with scrape type 1
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_front_driver-1774537139367.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_driver-1774537139367.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_rear_driver-1774537172487.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_driver-1774537172487.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_front_passenger-1774537148374.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_passenger-1774537148374.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_rear_passenger-1774537166096.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_passenger-1774537166096.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_front_seats-1774537182116.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_front_seats-1774537182116.jpeg not downloaded yet
2026-03-29 20:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20421191.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_rear_seats-1774537228345.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_rear_seats-1774537228345.jpeg not downloaded yet
2026-03-29 20:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_dashboard-1774537286373.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_dashboard-1774537286373.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Finstrument_cluster-1774537341481.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/instrument_cluster-1774537341481.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_boot-1774537267998.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_boot-1774537267998.jpeg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1650%252F19121650%252Fdocs_service_history-1774545387719.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D802b8fa1e79734ab3a189d5a9fc3861e%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1650/19121650/docs_service_history-1774545387719.jpeg?ixlib=js-3.8.0&auto=format&s=802b8fa1e79734ab3a189d5a9fc3861e not downloaded yet
2026-03-29 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0cce4bb-60d6-554b-9b29-d1b8fc06a76c with identifier: 20421191
2026-03-29 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c with scrape type 1
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_front_driver-1774688970108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_driver-1774688970108.jpg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_rear_driver-1774688962137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_driver-1774688962137.jpg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_front_passenger-1774688960994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_passenger-1774688960994.jpg not downloaded yet
2026-03-29 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_rear_passenger-1774688965885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_passenger-1774688965885.jpg not downloaded yet
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_driver-1774537139367.jpeg> (referer: None)
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1191%252F20421191%252Finterior_front_seats-1774689389587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1191/20421191/interior_front_seats-1774689389587.jpg not downloaded yet
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1191%252F20421191%252Finterior_rear_seats-1774691847885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1191/20421191/interior_rear_seats-1774691847885.jpg not downloaded yet
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1191%252F20421191%252Finterior_dashboard-1774692275514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1191/20421191/interior_dashboard-1774692275514.jpg not downloaded yet
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1191%252F20421191%252Finterior_boot-1774692286364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1191/20421191/interior_boot-1774692286364.jpg not downloaded yet
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1191%252F20421191%252Fdamage_scratches-1774688964588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688964588.jpg not downloaded yet
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1191%252F20421191%252Fdamage_scratches-1774688982476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688982476.jpg not downloaded yet
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7b98d0>
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_front_driver-1774537139367.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_driver-1774537139367.jpeg saved to cache
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_passenger-1774537148374.jpeg> (referer: None)
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_driver-1774537172487.jpeg> (referer: None)
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1650/19121650/interior_front_seats-1774537182116.jpeg> (referer: None)
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7baf10>
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_front_passenger-1774537148374.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_passenger-1774537148374.jpeg saved to cache
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2ec950>
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_rear_driver-1774537172487.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_driver-1774537172487.jpeg saved to cache
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+\x7f1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02U\xeb\x00+t\xaf\x00\x00\x00\x00'
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c2fb50>
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_front_seats-1774537182116.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_front_seats-1774537182116.jpeg saved to cache
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_passenger-1774688965885.jpg> (referer: None)
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688982476.jpg> (referer: None)
2026-03-29 20:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688964588.jpg> (referer: None)
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d73a1d0>
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_rear_passenger-1774688965885.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_passenger-1774688965885.jpg saved to cache
2026-03-29 20:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8eb50>
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1191%252F20421191%252Fdamage_scratches-1774688982476.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688982476.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d738450>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1191%252F20421191%252Fdamage_scratches-1774688964588.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688964588.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1191/20421191/interior_boot-1774692286364.jpg> (referer: None)
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1191/20421191/interior_rear_seats-1774691847885.jpg> (referer: None)
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1191/20421191/interior_dashboard-1774692275514.jpg> (referer: None)
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1191/20421191/interior_front_seats-1774689389587.jpg> (referer: None)
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2dcd0>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1191%252F20421191%252Finterior_boot-1774692286364.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1191/20421191/interior_boot-1774692286364.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d03e390>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1191%252F20421191%252Finterior_rear_seats-1774691847885.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1191/20421191/interior_rear_seats-1774691847885.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d01d190>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1191%252F20421191%252Finterior_dashboard-1774692275514.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1191/20421191/interior_dashboard-1774692275514.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0abf10>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1191%252F20421191%252Finterior_front_seats-1774689389587.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1191/20421191/interior_front_seats-1774689389587.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_driver-1774688970108.jpg> (referer: None)
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_driver-1774688962137.jpg> (referer: None)
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_passenger-1774688960994.jpg> (referer: None)
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec90a90>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_front_driver-1774688970108.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_driver-1774688970108.jpg saved to cache
2026-03-29 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20466618.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d717310>
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_rear_driver-1774688962137.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_driver-1774688962137.jpg saved to cache
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cadcfd0>
2026-03-29 20:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1191%252F20421191%252Fexterior_front_passenger-1774688960994.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_passenger-1774688960994.jpg saved to cache
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c
2026-03-29 20:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0cce4bb-60d6-554b-9b29-d1b8fc06a76c, skipping ID generation
2026-03-29 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c with scrape type 1
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0cce4bb-60d6-554b-9b29-d1b8fc06a76c sending to next pipeline
2026-03-29 20:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a0cce4bb-60d6-554b-9b29-d1b8fc06a76c, identifier: 20421191
2026-03-29 20:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a0cce4bb-60d6-554b-9b29-d1b8fc06a76c with identifier: 20421191
2026-03-29 20:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a0cce4bb-60d6-554b-9b29-d1b8fc06a76c with identifier: 20421191
2026-03-29 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a0cce4bb-60d6-554b-9b29-d1b8fc06a76c with identifier: 20421191 to the API
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_passenger-1774688960994.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a0cce4bb-60d6-554b-9b29-d1b8fc06a76c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KX65 VFL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20421191',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Nissan',
'model': 'Juke',
'odometer': 48809,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707864,
'Height': 2126,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_driver-1774688970108.jpg',
'Width': 2835},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1110533,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_driver-1774688962137.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631702,
'Height': 2598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_front_passenger-1774688960994.jpg',
'Width': 3464},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1237376,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1191/20421191/exterior_rear_passenger-1774688965885.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2568710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1191/20421191/interior_front_seats-1774689389587.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 796073,
'Height': 2177,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1191/20421191/interior_rear_seats-1774691847885.jpg',
'Width': 2903},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1877167,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1191/20421191/interior_dashboard-1774692275514.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737841,
'Height': 1377,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1191/20421191/interior_boot-1774692286364.jpg',
'Width': 1836},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1472119,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688964588.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cce4bb-60d6-554b-9b29-d1b8fc06a76c/a0cce4bb-60d6-554b-9b29-d1b8fc06a76c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1221890,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1191/20421191/damage_scratches-1774688982476.jpg',
'Width': 4032}],
'price': 3767,
'price_includes_vat': False,
'registration_date': '2015-09-21',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Acenta DiG-T',
'transmission': 'manual',
'trim': 'Acenta DiG-T',
'vin': 'SJNFEAF15U7158903',
'year': 2015}
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421191%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [motorway.uk] INFO: Saving data for 20421191: {'created_time': 1774816281.72054, 'last_price_update_time': 1774816281.72055, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20421191') HTTP/1.1" 204 0
2026-03-29 20:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9053213b-5168-5326-8ddc-e65ed3ab295b with identifier: 20466618
2026-03-29 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9053213b-5168-5326-8ddc-e65ed3ab295b with scrape type 1
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_front_driver-1774690449817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_driver-1774690449817.jpg not downloaded yet
2026-03-29 20:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1650/19121650/docs_service_history-1774545387719.jpeg?ixlib=js-3.8.0&auto=format&s=802b8fa1e79734ab3a189d5a9fc3861e> (referer: None)
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_rear_driver-1774690484485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_driver-1774690484485.jpg not downloaded yet
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_front_passenger-1774690530207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_passenger-1774690530207.jpg not downloaded yet
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_rear_passenger-1774690497473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_passenger-1774690497473.jpg not downloaded yet
2026-03-29 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6618%252F20466618%252Finterior_front_seats-1774691637100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6618/20466618/interior_front_seats-1774691637100.jpg not downloaded yet
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6618%252F20466618%252Finterior_rear_seats-1774691684938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6618/20466618/interior_rear_seats-1774691684938.jpg not downloaded yet
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Finterior_dashboard-1774691564293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/interior_dashboard-1774691564293.jpg not downloaded yet
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d757410>
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1650%252F19121650%252Fdocs_service_history-1774545387719.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D802b8fa1e79734ab3a189d5a9fc3861e') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1650/19121650/docs_service_history-1774545387719.jpeg?ixlib=js-3.8.0&auto=format&s=802b8fa1e79734ab3a189d5a9fc3861e saved to cache
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6618%252F20466618%252Finstrument_cluster-1774716800457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6618/20466618/instrument_cluster-1774716800457.jpg not downloaded yet
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6618%252F20466618%252Finterior_boot-1774691575790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6618/20466618/interior_boot-1774691575790.jpg not downloaded yet
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6618%252F20466618%252Fdocs_service_history-1774692416947.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db8d25ea831130268998a9de6d4755d50%27 HTTP/1.1" 200 None
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6618/20466618/docs_service_history-1774692416947.jpg?ixlib=js-3.8.0&auto=format&s=b8d25ea831130268998a9de6d4755d50 not downloaded yet
2026-03-29 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1650/19121650/instrument_cluster-1774537341481.jpeg> (referer: None)
2026-03-29 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_driver-1774690449817.jpg> (referer: None)
2026-03-29 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1650/19121650/interior_dashboard-1774537286373.jpeg> (referer: None)
2026-03-29 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1650/19121650/interior_rear_seats-1774537228345.jpeg> (referer: None)
2026-03-29 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1650/19121650/interior_boot-1774537267998.jpeg> (referer: None)
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1bh\x9a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02w\xb2\x00\x1b^\x18\x00\x00\x00\x00'
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cea9090>
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Finstrument_cluster-1774537341481.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/instrument_cluster-1774537341481.jpeg saved to cache
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d26bbd0>
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_front_driver-1774690449817.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_driver-1774690449817.jpg saved to cache
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'P\xf4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\t\x9e\x00'Fr\x00\x00\x00\x00"
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d260210>
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_dashboard-1774537286373.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_dashboard-1774537286373.jpeg saved to cache
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00 \xf7\xf5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02E`\x00 \xeds\x00\x00\x00\x00'
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9dad10>
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_rear_seats-1774537228345.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_rear_seats-1774537228345.jpeg saved to cache
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:31:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\x88\xb2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x035\xff\x003~0\x00\x00\x00\x00'
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e95d050>
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1650%252F19121650%252Finterior_boot-1774537267998.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1650/19121650/interior_boot-1774537267998.jpeg saved to cache
2026-03-29 20:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6618/20466618/docs_service_history-1774692416947.jpg?ixlib=js-3.8.0&auto=format&s=b8d25ea831130268998a9de6d4755d50> (referer: None)
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6618/20466618/interior_boot-1774691575790.jpg> (referer: None)
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9d9190>
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6618%252F20466618%252Fdocs_service_history-1774692416947.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db8d25ea831130268998a9de6d4755d50') HTTP/1.1" 204 0
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6618/20466618/docs_service_history-1774692416947.jpg?ixlib=js-3.8.0&auto=format&s=b8d25ea831130268998a9de6d4755d50 saved to cache
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20394387.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca37710>
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6618%252F20466618%252Finterior_boot-1774691575790.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6618/20466618/interior_boot-1774691575790.jpg saved to cache
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20454779.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee33abaf-ac5c-5fec-8d3b-33c51dad5129 with identifier: 20394387
2026-03-29 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129 with scrape type 1
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_front_driver-1774544117893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_driver-1774544117893.jpg not downloaded yet
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6618/20466618/instrument_cluster-1774716800457.jpg> (referer: None)
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_rear_driver-1774544243026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_driver-1774544243026.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_front_passenger-1774544173832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_passenger-1774544173832.jpg not downloaded yet
2026-03-29 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b99f11-e806-55f8-8d71-8162f34ab6c1 with identifier: 20454779
2026-03-29 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b99f11-e806-55f8-8d71-8162f34ab6c1 with scrape type 1
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_front_driver-1774529371972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_driver-1774529371972.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_rear_passenger-1774544413515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_passenger-1774544413515.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_rear_driver-1774529369115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_driver-1774529369115.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4387%252F20394387%252Finterior_front_seats-1774630372139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4387/20394387/interior_front_seats-1774630372139.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_front_passenger-1774539549011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_passenger-1774539549011.jpg not downloaded yet
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e969890>
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6618%252F20466618%252Finstrument_cluster-1774716800457.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6618/20466618/instrument_cluster-1774716800457.jpg saved to cache
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4387%252F20394387%252Finterior_rear_seats-1774545584138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4387/20394387/interior_rear_seats-1774545584138.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_rear_passenger-1774529439269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_passenger-1774529439269.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Finterior_dashboard-1774630482813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/interior_dashboard-1774630482813.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Finterior_front_seats-1774540058721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/interior_front_seats-1774540058721.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Finstrument_cluster-1774545443910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/instrument_cluster-1774545443910.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Finterior_rear_seats-1774540076483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/interior_rear_seats-1774540076483.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4387%252F20394387%252Finterior_boot-1774548933083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4387/20394387/interior_boot-1774548933083.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Finterior_dashboard-1774540240652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/interior_dashboard-1774540240652.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4387%252F20394387%252Fdamage_paintwork-1774775531321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4387/20394387/damage_paintwork-1774775531321.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Finterior_boot-1774540232688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/interior_boot-1774540232688.jpg not downloaded yet
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Fdamage_scratches-1774529479958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/damage_scratches-1774529479958.jpg not downloaded yet
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_driver-1774544117893.jpg> (referer: None)
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4779%252F20454779%252F20454779-damage_scratches-modified-1774782908883.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4779/20454779/20454779-damage_scratches-modified-1774782908883.jpeg not downloaded yet
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_passenger-1774690497473.jpg> (referer: None)
2026-03-29 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_driver-1774690484485.jpg> (referer: None)
2026-03-29 20:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_passenger-1774690530207.jpg> (referer: None)
2026-03-29 20:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6618/20466618/interior_dashboard-1774691564293.jpg> (referer: None)
2026-03-29 20:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6618/20466618/interior_rear_seats-1774691684938.jpg> (referer: None)
2026-03-29 20:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6618/20466618/interior_front_seats-1774691637100.jpg> (referer: None)
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce61250>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_front_driver-1774544117893.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_driver-1774544117893.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce636d0>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_rear_passenger-1774690497473.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_passenger-1774690497473.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01c790>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_rear_driver-1774690484485.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_driver-1774690484485.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cac8690>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Fexterior_front_passenger-1774690530207.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_passenger-1774690530207.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24fb50>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6618%252F20466618%252Finterior_dashboard-1774691564293.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6618/20466618/interior_dashboard-1774691564293.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24e210>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6618%252F20466618%252Finterior_rear_seats-1774691684938.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6618/20466618/interior_rear_seats-1774691684938.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca5c650>
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6618%252F20466618%252Finterior_front_seats-1774691637100.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6618/20466618/interior_front_seats-1774691637100.jpg saved to cache
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9053213b-5168-5326-8ddc-e65ed3ab295b
2026-03-29 20:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9053213b-5168-5326-8ddc-e65ed3ab295b, skipping ID generation
2026-03-29 20:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9053213b-5168-5326-8ddc-e65ed3ab295b with scrape type 1
2026-03-29 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9053213b-5168-5326-8ddc-e65ed3ab295b sending to next pipeline
2026-03-29 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9053213b-5168-5326-8ddc-e65ed3ab295b, identifier: 20466618
2026-03-29 20:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9053213b-5168-5326-8ddc-e65ed3ab295b with identifier: 20466618
2026-03-29 20:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9053213b-5168-5326-8ddc-e65ed3ab295b with identifier: 20466618
2026-03-29 20:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9053213b-5168-5326-8ddc-e65ed3ab295b with identifier: 20466618 to the API
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6618/20466618/interior_front_seats-1774691637100.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9053213b-5168-5326-8ddc-e65ed3ab295b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HN14 WLD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20466618',
'listing': 'auction',
'location': 'Hampshire Eastleigh',
'make': 'Skoda',
'model': 'Rapid',
'odometer': 77943,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635078,
'Height': 2580,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_driver-1774690449817.jpg',
'Width': 3440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2215449,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_driver-1774690484485.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280679,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_front_passenger-1774690530207.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1827023,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6618/20466618/exterior_rear_passenger-1774690497473.jpg',
'Width': 3642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3772243,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6618/20466618/interior_front_seats-1774691637100.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3533526,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6618/20466618/interior_rear_seats-1774691684938.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3142617,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6618/20466618/interior_dashboard-1774691564293.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311525,
'Height': 1331,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6618/20466618/instrument_cluster-1774716800457.jpg',
'Width': 1775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4736331,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6618/20466618/interior_boot-1774691575790.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9053213b-5168-5326-8ddc-e65ed3ab295b/9053213b-5168-5326-8ddc-e65ed3ab295b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452937,
'Height': 2564,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6618/20466618/docs_service_history-1774692416947.jpg?ixlib=js-3.8.0&auto=format&s=b8d25ea831130268998a9de6d4755d50',
'Width': 1777}],
'price': 2052,
'price_includes_vat': False,
'registration_date': '2014-06-13',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Rapid Elegance TSI',
'transmission': 'manual',
'trim': 'Elegance TSI',
'vin': 'TMBBN6NH4E4035393',
'year': 2014}
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466618%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [motorway.uk] INFO: Saving data for 20466618: {'created_time': 1774816285.391771, 'last_price_update_time': 1774816285.391784, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20466618') HTTP/1.1" 204 0
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4779/20454779/20454779-damage_scratches-modified-1774782908883.jpeg> (referer: None)
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4779/20454779/interior_boot-1774540232688.jpg> (referer: None)
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e02d7d0>
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4779%252F20454779%252F20454779-damage_scratches-modified-1774782908883.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4779/20454779/20454779-damage_scratches-modified-1774782908883.jpeg saved to cache
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbe8ad0>
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Finterior_boot-1774540232688.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/interior_boot-1774540232688.jpg saved to cache
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4387/20394387/damage_paintwork-1774775531321.jpg> (referer: None)
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4779/20454779/damage_scratches-1774529479958.jpg> (referer: None)
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20381560.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488633.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4779/20454779/interior_rear_seats-1774540076483.jpg> (referer: None)
2026-03-29 20:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4779/20454779/interior_dashboard-1774540240652.jpg> (referer: None)
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e02c750>
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4387%252F20394387%252Fdamage_paintwork-1774775531321.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4387/20394387/damage_paintwork-1774775531321.jpg saved to cache
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d08b990>
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Fdamage_scratches-1774529479958.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/damage_scratches-1774529479958.jpg saved to cache
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7f562bf-955a-5e71-83ef-4a22f1285313 with identifier: 20381560
2026-03-29 20:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f562bf-955a-5e71-83ef-4a22f1285313 with scrape type 1
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_front_driver-1774630071030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_driver-1774630071030.jpg not downloaded yet
2026-03-29 20:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 with identifier: 20488633
2026-03-29 20:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 with scrape type 1
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_front_driver-1774711735665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_driver-1774711735665.jpg not downloaded yet
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_rear_driver-1774632016169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_driver-1774632016169.jpg not downloaded yet
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_rear_driver-1774711757534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_driver-1774711757534.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_front_passenger-1774630069253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_passenger-1774630069253.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_front_passenger-1774711790510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_passenger-1774711790510.jpg not downloaded yet
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec747d0>
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Finterior_rear_seats-1774540076483.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/interior_rear_seats-1774540076483.jpg saved to cache
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca28690>
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Finterior_dashboard-1774540240652.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/interior_dashboard-1774540240652.jpg saved to cache
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_rear_passenger-1774632035618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_passenger-1774632035618.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_rear_passenger-1774711764807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_passenger-1774711764807.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1560%252F20381560%252Finterior_front_seats-1774634442601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1560/20381560/interior_front_seats-1774634442601.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20488633%252Finterior_front_seats-1774712255086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20488633/interior_front_seats-1774712255086.jpg not downloaded yet
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4387/20394387/instrument_cluster-1774545443910.jpg> (referer: None)
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1560%252F20381560%252Finterior_rear_seats-1774632260152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1560/20381560/interior_rear_seats-1774632260152.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20488633%252Finterior_rear_seats-1774712277200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20488633/interior_rear_seats-1774712277200.jpg not downloaded yet
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_passenger-1774539549011.jpg> (referer: None)
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Finterior_dashboard-1774631320726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/interior_dashboard-1774631320726.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Finterior_dashboard-1774712348288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/interior_dashboard-1774712348288.jpg not downloaded yet
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_passenger-1774529439269.jpg> (referer: None)
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1560%252F20381560%252Finterior_boot-1774631301300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1560/20381560/interior_boot-1774631301300.jpg not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Finstrument_cluster-1774712342571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/instrument_cluster-1774712342571.jpg not downloaded yet
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4779/20454779/interior_front_seats-1774540058721.jpg> (referer: None)
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1560%252F20381560%252Fdocs_service_history-1774631589673.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8ca6b84241def22c94e517044e836a76%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631589673.jpg?ixlib=js-3.8.0&auto=format&s=8ca6b84241def22c94e517044e836a76 not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20488633%252Finterior_boot-1774712416516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20488633/interior_boot-1774712416516.jpg not downloaded yet
2026-03-29 20:31:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca11090>
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Finstrument_cluster-1774545443910.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/instrument_cluster-1774545443910.jpg saved to cache
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1560%252F20381560%252Fdocs_service_history-1774631628202.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a3e3e185d8416bd3787b59700a8e177%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631628202.jpg?ixlib=js-3.8.0&auto=format&s=4a3e3e185d8416bd3787b59700a8e177 not downloaded yet
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8633%252F20488633%252Fdocs_service_history-1774712648196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D701963f6e5a3064234eea8e0999cf5c4%27 HTTP/1.1" 200 None
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20488633/docs_service_history-1774712648196.jpg?ixlib=js-3.8.0&auto=format&s=701963f6e5a3064234eea8e0999cf5c4 not downloaded yet
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca45fd0>
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_front_passenger-1774539549011.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_passenger-1774539549011.jpg saved to cache
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca0d3d0>
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_rear_passenger-1774529439269.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_passenger-1774529439269.jpg saved to cache
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca46010>
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4779%252F20454779%252Finterior_front_seats-1774540058721.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4779/20454779/interior_front_seats-1774540058721.jpg saved to cache
2026-03-29 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4387/20394387/interior_dashboard-1774630482813.jpg> (referer: None)
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4387/20394387/interior_rear_seats-1774545584138.jpg> (referer: None)
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4387/20394387/interior_front_seats-1774630372139.jpg> (referer: None)
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_driver-1774711735665.jpg> (referer: None)
2026-03-29 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4387/20394387/interior_boot-1774548933083.jpg> (referer: None)
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d770cd0>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Finterior_dashboard-1774630482813.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/interior_dashboard-1774630482813.jpg saved to cache
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1116&page=31&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca19e10>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4387%252F20394387%252Finterior_rear_seats-1774545584138.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4387/20394387/interior_rear_seats-1774545584138.jpg saved to cache
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c253390>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4387%252F20394387%252Finterior_front_seats-1774630372139.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4387/20394387/interior_front_seats-1774630372139.jpg saved to cache
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edcc590>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_front_driver-1774711735665.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_driver-1774711735665.jpg saved to cache
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce40d10>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4387%252F20394387%252Finterior_boot-1774548933083.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4387/20394387/interior_boot-1774548933083.jpg saved to cache
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20255071
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20418634
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20499940
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20473047
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20441126
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441126%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 20441126: 1
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20467526
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20285675
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20295392
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720295392%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 20295392: 1
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 10200221
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 13316160
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20479742
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20477549
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 16662751
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716662751%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 16662751: 1
2026-03-29 20:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631628202.jpg?ixlib=js-3.8.0&auto=format&s=4a3e3e185d8416bd3787b59700a8e177> (referer: None)
2026-03-29 20:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 12330372
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 19684886
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 17190543
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 14032750
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20240321
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20020846
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 14443515
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714443515%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 14443515: 1
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20470846
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 17982437
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717982437%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 17982437: 1
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20156998
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 18987203
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 5963462
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 17363006
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 18720332
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20374415
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720374415%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 20374415: 1
2026-03-29 20:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631589673.jpg?ixlib=js-3.8.0&auto=format&s=8ca6b84241def22c94e517044e836a76> (referer: None)
2026-03-29 20:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20488633/docs_service_history-1774712648196.jpg?ixlib=js-3.8.0&auto=format&s=701963f6e5a3064234eea8e0999cf5c4> (referer: None)
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20438823
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20489356
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 17446143
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 18406701
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20403434
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 19912396
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719912396%27 HTTP/1.1" 200 None
2026-03-29 20:31:27 [motorway.uk] INFO: Scrape type for 19912396: 2
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 5587668
2026-03-29 20:31:27 [motorway.uk] INFO: Found listing with ID: 20325290
2026-03-29 20:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1560/20381560/interior_front_seats-1774634442601.jpg> (referer: None)
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce42e10>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1560%252F20381560%252Fdocs_service_history-1774631628202.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a3e3e185d8416bd3787b59700a8e177') HTTP/1.1" 204 0
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631628202.jpg?ixlib=js-3.8.0&auto=format&s=4a3e3e185d8416bd3787b59700a8e177 saved to cache
2026-03-29 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14bcfb50>
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1560%252F20381560%252Fdocs_service_history-1774631589673.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8ca6b84241def22c94e517044e836a76') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631589673.jpg?ixlib=js-3.8.0&auto=format&s=8ca6b84241def22c94e517044e836a76 saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c29cc50>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8633%252F20488633%252Fdocs_service_history-1774712648196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D701963f6e5a3064234eea8e0999cf5c4') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20488633/docs_service_history-1774712648196.jpg?ixlib=js-3.8.0&auto=format&s=701963f6e5a3064234eea8e0999cf5c4 saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d092fd0>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1560%252F20381560%252Finterior_front_seats-1774634442601.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1560/20381560/interior_front_seats-1774634442601.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8633/20488633/interior_front_seats-1774712255086.jpg> (referer: None)
2026-03-29 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20488633/interior_dashboard-1774712348288.jpg> (referer: None)
2026-03-29 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20488633/instrument_cluster-1774712342571.jpg> (referer: None)
2026-03-29 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1560/20381560/interior_dashboard-1774631320726.jpg> (referer: None)
2026-03-29 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1560/20381560/interior_boot-1774631301300.jpg> (referer: None)
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d090410>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20488633%252Finterior_front_seats-1774712255086.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20488633/interior_front_seats-1774712255086.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8633/20488633/interior_boot-1774712416516.jpg> (referer: None)
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d093290>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Finterior_dashboard-1774712348288.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/interior_dashboard-1774712348288.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea479d0>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Finstrument_cluster-1774712342571.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/instrument_cluster-1774712342571.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed99e10>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Finterior_dashboard-1774631320726.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/interior_dashboard-1774631320726.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2d9910>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1560%252F20381560%252Finterior_boot-1774631301300.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1560/20381560/interior_boot-1774631301300.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13a190>
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20488633%252Finterior_boot-1774712416516.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20488633/interior_boot-1774712416516.jpg saved to cache
2026-03-29 20:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8633/20488633/interior_rear_seats-1774712277200.jpg> (referer: None)
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1560/20381560/interior_rear_seats-1774632260152.jpg> (referer: None)
2026-03-29 20:31:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d1490>
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20488633%252Finterior_rear_seats-1774712277200.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20488633/interior_rear_seats-1774712277200.jpg saved to cache
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12c650>
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1560%252F20381560%252Finterior_rear_seats-1774632260152.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1560/20381560/interior_rear_seats-1774632260152.jpg saved to cache
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_passenger-1774711764807.jpg> (referer: None)
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c29e290>
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_rear_passenger-1774711764807.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_passenger-1774711764807.jpg saved to cache
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_passenger-1774711790510.jpg> (referer: None)
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_passenger-1774632035618.jpg> (referer: None)
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c6210>
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_front_passenger-1774711790510.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_passenger-1774711790510.jpg saved to cache
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c29fd10>
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_rear_passenger-1774632035618.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_passenger-1774632035618.jpg saved to cache
2026-03-29 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_driver-1774711757534.jpg> (referer: None)
2026-03-29 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_passenger-1774630069253.jpg> (referer: None)
2026-03-29 20:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2611d0>
2026-03-29 20:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20488633%252Fexterior_rear_driver-1774711757534.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_driver-1774711757534.jpg saved to cache
2026-03-29 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31
2026-03-29 20:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31, skipping ID generation
2026-03-29 20:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 with scrape type 1
2026-03-29 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 sending to next pipeline
2026-03-29 20:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31, identifier: 20488633
2026-03-29 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 with identifier: 20488633
2026-03-29 20:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 with identifier: 20488633
2026-03-29 20:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31 with identifier: 20488633 to the API
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_driver-1774711757534.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KR70 GZB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488633',
'listing': 'auction',
'location': 'Essex Clacton-on-Sea',
'make': 'Ford',
'model': 'Focus',
'odometer': 51000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2152633,
'Height': 2721,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_driver-1774711735665.jpg',
'Width': 3628},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2274431,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_driver-1774711757534.jpg',
'Width': 3562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2000865,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_front_passenger-1774711790510.jpg',
'Width': 3495},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170140,
'Height': 2693,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8633/20488633/exterior_rear_passenger-1774711764807.jpg',
'Width': 3591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3438409,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8633/20488633/interior_front_seats-1774712255086.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4205972,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8633/20488633/interior_rear_seats-1774712277200.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1697422,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8633/20488633/interior_dashboard-1774712348288.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1816786,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8633/20488633/instrument_cluster-1774712342571.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4428824,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8633/20488633/interior_boot-1774712416516.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31/9a0bd0fb-9fef-55e8-92e1-22a2bdfd7b31_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1057183,
'Height': 3348,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20488633/docs_service_history-1774712648196.jpg?ixlib=js-3.8.0&auto=format&s=701963f6e5a3064234eea8e0999cf5c4',
'Width': 2453}],
'price': 9690,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Titanium X Auto',
'transmission': 'automatic',
'trim': 'Titanium X Auto',
'vin': 'WF0NXXGCHNLY58988',
'year': 2020}
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488633%27 HTTP/1.1" 200 None
2026-03-29 20:31:30 [motorway.uk] INFO: Saving data for 20488633: {'created_time': 1774816290.980054, 'last_price_update_time': 1774816290.980066, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488633') HTTP/1.1" 204 0
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca34f50>
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_front_passenger-1774630069253.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_passenger-1774630069253.jpg saved to cache
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_driver-1774630071030.jpg> (referer: None)
2026-03-29 20:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_driver-1774632016169.jpg> (referer: None)
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14bcd0d0>
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_front_driver-1774630071030.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_driver-1774630071030.jpg saved to cache
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d138e50>
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1560%252F20381560%252Fexterior_rear_driver-1774632016169.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_driver-1774632016169.jpg saved to cache
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7f562bf-955a-5e71-83ef-4a22f1285313
2026-03-29 20:31:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7f562bf-955a-5e71-83ef-4a22f1285313, skipping ID generation
2026-03-29 20:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f562bf-955a-5e71-83ef-4a22f1285313 with scrape type 1
2026-03-29 20:31:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7f562bf-955a-5e71-83ef-4a22f1285313 sending to next pipeline
2026-03-29 20:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d7f562bf-955a-5e71-83ef-4a22f1285313, identifier: 20381560
2026-03-29 20:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d7f562bf-955a-5e71-83ef-4a22f1285313 with identifier: 20381560
2026-03-29 20:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d7f562bf-955a-5e71-83ef-4a22f1285313 with identifier: 20381560
2026-03-29 20:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d7f562bf-955a-5e71-83ef-4a22f1285313 with identifier: 20381560 to the API
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_driver-1774632016169.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd7f562bf-955a-5e71-83ef-4a22f1285313',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA66 FSE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20381560',
'listing': 'auction',
'location': 'Oxfordshire Faringdon',
'make': 'Kia',
'model': 'Sportage',
'odometer': 93000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1372542,
'Height': 2870,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_driver-1774630071030.jpg',
'Width': 3827},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1186979,
'Height': 2726,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_driver-1774632016169.jpg',
'Width': 3634},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683871,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_front_passenger-1774630069253.jpg',
'Width': 3766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1061498,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1560/20381560/exterior_rear_passenger-1774632035618.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1579207,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1560/20381560/interior_front_seats-1774634442601.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1676497,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1560/20381560/interior_rear_seats-1774632260152.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 991946,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1560/20381560/interior_dashboard-1774631320726.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1414208,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1560/20381560/interior_boot-1774631301300.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723639,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631589673.jpg?ixlib=js-3.8.0&auto=format&s=8ca6b84241def22c94e517044e836a76',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f562bf-955a-5e71-83ef-4a22f1285313/d7f562bf-955a-5e71-83ef-4a22f1285313_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581640,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1560/20381560/docs_service_history-1774631628202.jpg?ixlib=js-3.8.0&auto=format&s=4a3e3e185d8416bd3787b59700a8e177',
'Width': 3840}],
'price': 4902,
'price_includes_vat': False,
'registration_date': '2016-11-29',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 2 CRDI ISG',
'transmission': 'manual',
'trim': '2 CRDI ISG',
'vin': 'U5YPH815LHL206498',
'year': 2016}
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381560%27 HTTP/1.1" 200 None
2026-03-29 20:31:32 [motorway.uk] INFO: Saving data for 20381560: {'created_time': 1774816292.305282, 'last_price_update_time': 1774816292.305293, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20381560') HTTP/1.1" 204 0
2026-03-29 20:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_passenger-1774544413515.jpg> (referer: None)
2026-03-29 20:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_driver-1774529369115.jpg> (referer: None)
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14bce410>
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_rear_passenger-1774544413515.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_passenger-1774544413515.jpg saved to cache
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2c1a90>
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_rear_driver-1774529369115.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_driver-1774529369115.jpg saved to cache
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_driver-1774529371972.jpg> (referer: None)
2026-03-29 20:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_passenger-1774544173832.jpg> (referer: None)
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eab1550>
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4779%252F20454779%252Fexterior_front_driver-1774529371972.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_driver-1774529371972.jpg saved to cache
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74b99f11-e806-55f8-8d71-8162f34ab6c1
2026-03-29 20:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74b99f11-e806-55f8-8d71-8162f34ab6c1, skipping ID generation
2026-03-29 20:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b99f11-e806-55f8-8d71-8162f34ab6c1 with scrape type 1
2026-03-29 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74b99f11-e806-55f8-8d71-8162f34ab6c1 sending to next pipeline
2026-03-29 20:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 74b99f11-e806-55f8-8d71-8162f34ab6c1, identifier: 20454779
2026-03-29 20:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 74b99f11-e806-55f8-8d71-8162f34ab6c1 with identifier: 20454779
2026-03-29 20:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 74b99f11-e806-55f8-8d71-8162f34ab6c1 with identifier: 20454779
2026-03-29 20:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 74b99f11-e806-55f8-8d71-8162f34ab6c1 with identifier: 20454779 to the API
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_driver-1774529371972.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '74b99f11-e806-55f8-8d71-8162f34ab6c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU18 MLV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20454779',
'listing': 'auction',
'location': 'Tyne and Wear Newcastle upon Tyne',
'make': 'Ford',
'model': 'Tourneo',
'odometer': 79142,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1185631,
'Height': 2707,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_driver-1774529371972.jpg',
'Width': 3609},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 886948,
'Height': 2345,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_driver-1774529369115.jpg',
'Width': 3127},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 652830,
'Height': 2240,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_front_passenger-1774539549011.jpg',
'Width': 2987},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826608,
'Height': 2622,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4779/20454779/exterior_rear_passenger-1774529439269.jpg',
'Width': 3496},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1286119,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4779/20454779/interior_front_seats-1774540058721.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1638059,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4779/20454779/interior_rear_seats-1774540076483.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1181763,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4779/20454779/interior_dashboard-1774540240652.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1462220,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4779/20454779/interior_boot-1774540232688.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630368,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/4779/20454779/damage_scratches-1774529479958.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74b99f11-e806-55f8-8d71-8162f34ab6c1/74b99f11-e806-55f8-8d71-8162f34ab6c1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 15703,
'Height': 377,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4779/20454779/20454779-damage_scratches-modified-1774782908883.jpeg',
'Width': 503}],
'price': 10991,
'price_includes_vat': False,
'registration_date': '2018-04-20',
'seats_number': None,
'seller_name': None,
'title': 'Ford Tourneo Custom 310 T-NIUM TDCI',
'transmission': 'manual',
'trim': 'Custom 310 T-NIUM TDCI',
'vin': 'WF03XXTTG3JS43211',
'year': 2018}
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454779%27 HTTP/1.1" 200 None
2026-03-29 20:31:33 [motorway.uk] INFO: Saving data for 20454779: {'created_time': 1774816293.349536, 'last_price_update_time': 1774816293.349546, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20454779') HTTP/1.1" 204 0
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d12e850>
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_front_passenger-1774544173832.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_passenger-1774544173832.jpg saved to cache
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_passenger-1774537166096.jpeg> (referer: None)
2026-03-29 20:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_driver-1774544243026.jpg> (referer: None)
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d146110>
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1650%252F19121650%252Fexterior_rear_passenger-1774537166096.jpeg') HTTP/1.1" 204 0
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_passenger-1774537166096.jpeg saved to cache
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65feb5d8-2170-56d7-9aea-51b7c3394848
2026-03-29 20:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65feb5d8-2170-56d7-9aea-51b7c3394848, skipping ID generation
2026-03-29 20:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65feb5d8-2170-56d7-9aea-51b7c3394848 with scrape type 1
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65feb5d8-2170-56d7-9aea-51b7c3394848 sending to next pipeline
2026-03-29 20:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 65feb5d8-2170-56d7-9aea-51b7c3394848, identifier: 19121650
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1a190>
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4387%252F20394387%252Fexterior_rear_driver-1774544243026.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_driver-1774544243026.jpg saved to cache
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129
2026-03-29 20:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee33abaf-ac5c-5fec-8d3b-33c51dad5129, skipping ID generation
2026-03-29 20:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129 with scrape type 1
2026-03-29 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee33abaf-ac5c-5fec-8d3b-33c51dad5129 sending to next pipeline
2026-03-29 20:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ee33abaf-ac5c-5fec-8d3b-33c51dad5129, identifier: 20394387
2026-03-29 20:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 65feb5d8-2170-56d7-9aea-51b7c3394848 with identifier: 19121650
2026-03-29 20:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 65feb5d8-2170-56d7-9aea-51b7c3394848 with identifier: 19121650
2026-03-29 20:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 65feb5d8-2170-56d7-9aea-51b7c3394848 with identifier: 19121650 to the API
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_passenger-1774537166096.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '65feb5d8-2170-56d7-9aea-51b7c3394848',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC71 WCE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19121650',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'MG',
'model': 'HS',
'odometer': 35565,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1095475,
'Height': 2294,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_driver-1774537139367.jpeg',
'Width': 3058},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1644135,
'Height': 2645,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_driver-1774537172487.jpeg',
'Width': 3527},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1506112,
'Height': 2353,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_front_passenger-1774537148374.jpeg',
'Width': 3137},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1435200,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1650/19121650/exterior_rear_passenger-1774537166096.jpeg',
'Width': 3158},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3003676,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1650/19121650/interior_front_seats-1774537182116.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2309461,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1650/19121650/interior_rear_seats-1774537228345.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2841234,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1650/19121650/interior_dashboard-1774537286373.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1957964,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1650/19121650/instrument_cluster-1774537341481.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3587761,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1650/19121650/interior_boot-1774537267998.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65feb5d8-2170-56d7-9aea-51b7c3394848/65feb5d8-2170-56d7-9aea-51b7c3394848_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159246,
'Height': 1890,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1650/19121650/docs_service_history-1774545387719.jpeg?ixlib=js-3.8.0&auto=format&s=802b8fa1e79734ab3a189d5a9fc3861e',
'Width': 1320}],
'price': 11969,
'price_includes_vat': False,
'registration_date': '2021-11-12',
'seats_number': None,
'seller_name': None,
'title': 'MG HS Exclusive S-A',
'transmission': 'automatic',
'trim': 'Exclusive S-A',
'vin': 'LSJA24U90MN117003',
'year': 2021}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719121650%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [motorway.uk] INFO: Saving data for 19121650: {'created_time': 1774816294.291938, 'last_price_update_time': 1774816294.29195, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19121650') HTTP/1.1" 204 0
2026-03-29 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ee33abaf-ac5c-5fec-8d3b-33c51dad5129 with identifier: 20394387
2026-03-29 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ee33abaf-ac5c-5fec-8d3b-33c51dad5129 with identifier: 20394387
2026-03-29 20:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ee33abaf-ac5c-5fec-8d3b-33c51dad5129 with identifier: 20394387 to the API
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_driver-1774544243026.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ee33abaf-ac5c-5fec-8d3b-33c51dad5129',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JU04 MAG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20394387',
'listing': 'auction',
'location': 'Northamptonshire Kettering',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 120202,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 999898,
'Height': 2092,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_driver-1774544117893.jpg',
'Width': 2789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1532201,
'Height': 2916,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_driver-1774544243026.jpg',
'Width': 3888},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1103249,
'Height': 2192,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_front_passenger-1774544173832.jpg',
'Width': 2923},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 948138,
'Height': 2328,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4387/20394387/exterior_rear_passenger-1774544413515.jpg',
'Width': 3104},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2129939,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4387/20394387/interior_front_seats-1774630372139.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2036165,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4387/20394387/interior_rear_seats-1774545584138.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1604906,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4387/20394387/interior_dashboard-1774630482813.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326439,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4387/20394387/instrument_cluster-1774545443910.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2783948,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4387/20394387/interior_boot-1774548933083.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee33abaf-ac5c-5fec-8d3b-33c51dad5129/ee33abaf-ac5c-5fec-8d3b-33c51dad5129_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25894,
'Height': 275,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4387/20394387/damage_paintwork-1774775531321.jpg',
'Width': 367}],
'price': 2707,
'price_includes_vat': False,
'registration_date': '2009-01-21',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Vogue TDV8 A',
'transmission': 'automatic',
'trim': 'Vogue TDV8 A',
'vin': 'SALLMAM239A300212',
'year': 2009}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394387%27 HTTP/1.1" 200 None
2026-03-29 20:31:34 [motorway.uk] INFO: Saving data for 20394387: {'created_time': 1774816294.746227, 'last_price_update_time': 1774816294.746242, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20394387') HTTP/1.1" 204 0
2026-03-29 20:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19925842.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba2b3be-778d-58f0-8e6e-3376fc2a5aef with identifier: 19925842
2026-03-29 20:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef with scrape type 1
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_front_driver-1774701074595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_driver-1774701074595.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_rear_driver-1774701092840.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_driver-1774701092840.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_front_passenger-1774701122382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_passenger-1774701122382.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_rear_passenger-1774701107672.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_passenger-1774701107672.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5842%252F19925842%252Finterior_front_seats-1774701523643.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5842/19925842/interior_front_seats-1774701523643.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5842%252F19925842%252Finterior_rear_seats-1774701551478.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5842/19925842/interior_rear_seats-1774701551478.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Finterior_dashboard-1774701603399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/interior_dashboard-1774701603399.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Finstrument_cluster-1774701606428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/instrument_cluster-1774701606428.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5842%252F19925842%252Finterior_boot-1774701653649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5842/19925842/interior_boot-1774701653649.jpg not downloaded yet
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5842%252F19925842%252Fdocs_service_history-1774702008166.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfbe5e4947d078fd7901da4672e133ea3%27 HTTP/1.1" 200 None
2026-03-29 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5842/19925842/docs_service_history-1774702008166.jpg?ixlib=js-3.8.0&auto=format&s=fbe5e4947d078fd7901da4672e133ea3 not downloaded yet
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_driver-1774701074595.jpg> (referer: None)
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_passenger-1774701122382.jpg> (referer: None)
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc142f7e90>
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_front_driver-1774701074595.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_driver-1774701074595.jpg saved to cache
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2fe90>
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_front_passenger-1774701122382.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_passenger-1774701122382.jpg saved to cache
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_driver-1774701092840.jpg> (referer: None)
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5842/19925842/docs_service_history-1774702008166.jpg?ixlib=js-3.8.0&auto=format&s=fbe5e4947d078fd7901da4672e133ea3> (referer: None)
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2e110>
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_rear_driver-1774701092840.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_driver-1774701092840.jpg saved to cache
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e07d690>
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5842%252F19925842%252Fdocs_service_history-1774702008166.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfbe5e4947d078fd7901da4672e133ea3') HTTP/1.1" 204 0
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5842/19925842/docs_service_history-1774702008166.jpg?ixlib=js-3.8.0&auto=format&s=fbe5e4947d078fd7901da4672e133ea3 saved to cache
2026-03-29 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5842/19925842/interior_boot-1774701653649.jpg> (referer: None)
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5842/19925842/instrument_cluster-1774701606428.jpg> (referer: None)
2026-03-29 20:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5842/19925842/interior_dashboard-1774701603399.jpg> (referer: None)
2026-03-29 20:31:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0aad90>
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5842%252F19925842%252Finterior_boot-1774701653649.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5842/19925842/interior_boot-1774701653649.jpg saved to cache
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca2ebd0>
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Finstrument_cluster-1774701606428.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/instrument_cluster-1774701606428.jpg saved to cache
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c244610>
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Finterior_dashboard-1774701603399.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/interior_dashboard-1774701603399.jpg saved to cache
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5842/19925842/interior_rear_seats-1774701551478.jpg> (referer: None)
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d023350>
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5842%252F19925842%252Finterior_rear_seats-1774701551478.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5842/19925842/interior_rear_seats-1774701551478.jpg saved to cache
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_passenger-1774701107672.jpg> (referer: None)
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d186950>
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5842%252F19925842%252Fexterior_rear_passenger-1774701107672.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_passenger-1774701107672.jpg saved to cache
2026-03-29 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5842/19925842/interior_front_seats-1774701523643.jpg> (referer: None)
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:31:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d023dd0>
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5842%252F19925842%252Finterior_front_seats-1774701523643.jpg') HTTP/1.1" 204 0
2026-03-29 20:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5842/19925842/interior_front_seats-1774701523643.jpg saved to cache
2026-03-29 20:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef
2026-03-29 20:31:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cba2b3be-778d-58f0-8e6e-3376fc2a5aef, skipping ID generation
2026-03-29 20:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef with scrape type 1
2026-03-29 20:31:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cba2b3be-778d-58f0-8e6e-3376fc2a5aef sending to next pipeline
2026-03-29 20:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cba2b3be-778d-58f0-8e6e-3376fc2a5aef, identifier: 19925842
2026-03-29 20:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cba2b3be-778d-58f0-8e6e-3376fc2a5aef with identifier: 19925842
2026-03-29 20:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cba2b3be-778d-58f0-8e6e-3376fc2a5aef with identifier: 19925842
2026-03-29 20:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cba2b3be-778d-58f0-8e6e-3376fc2a5aef with identifier: 19925842 to the API
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5842/19925842/interior_front_seats-1774701523643.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cba2b3be-778d-58f0-8e6e-3376fc2a5aef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M8 DSS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19925842',
'listing': 'auction',
'location': 'Lincolnshire Lincoln',
'make': 'Audi',
'model': 'A4',
'odometer': 76400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1441415,
'Height': 2530,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_driver-1774701074595.jpg',
'Width': 3373},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1377467,
'Height': 2443,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_driver-1774701092840.jpg',
'Width': 3257},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1264725,
'Height': 2300,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_front_passenger-1774701122382.jpg',
'Width': 3067},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1160099,
'Height': 2233,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5842/19925842/exterior_rear_passenger-1774701107672.jpg',
'Width': 2977},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3983681,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5842/19925842/interior_front_seats-1774701523643.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3810821,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5842/19925842/interior_rear_seats-1774701551478.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1814062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5842/19925842/interior_dashboard-1774701603399.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2804181,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5842/19925842/instrument_cluster-1774701606428.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3118450,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5842/19925842/interior_boot-1774701653649.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cba2b3be-778d-58f0-8e6e-3376fc2a5aef/cba2b3be-778d-58f0-8e6e-3376fc2a5aef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657376,
'Height': 3511,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5842/19925842/docs_service_history-1774702008166.jpg?ixlib=js-3.8.0&auto=format&s=fbe5e4947d078fd7901da4672e133ea3',
'Width': 2343}],
'price': 12577,
'price_includes_vat': False,
'registration_date': '2016-05-16',
'seats_number': None,
'seller_name': None,
'title': 'Audi A4 S Line TDI Quattro Auto',
'transmission': 'automatic',
'trim': 'S Line TDI Quattro Auto',
'vin': 'WAUZZZF48GA098434',
'year': 2016}
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719925842%27 HTTP/1.1" 200 None
2026-03-29 20:31:40 [motorway.uk] INFO: Saving data for 19925842: {'created_time': 1774816300.602627, 'last_price_update_time': 1774816300.60264, 'auction_closing_time': 1774884600.0}
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19925842') HTTP/1.1" 204 0
2026-03-29 20:31:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.244(s), this was the 1st time calling it.
2026-03-29 20:31:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.535556326802737 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20374415.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a567e9ec-9b70-5723-b07f-c0b60fdac4ec with identifier: 20374415
2026-03-29 20:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec with scrape type 1
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_front_driver-1774687198608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_driver-1774687198608.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_rear_driver-1774687220725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_driver-1774687220725.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_front_passenger-1774687242934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_passenger-1774687242934.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_rear_passenger-1774687250940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_passenger-1774687250940.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4415%252F20374415%252Finterior_front_seats-1774687709114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4415/20374415/interior_front_seats-1774687709114.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4415%252F20374415%252Finterior_rear_seats-1774687730415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4415/20374415/interior_rear_seats-1774687730415.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Finterior_dashboard-1774687811544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/interior_dashboard-1774687811544.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4415%252F20374415%252Finterior_boot-1774691136849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4415/20374415/interior_boot-1774691136849.jpg not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4415%252F20374415%252Fdocs_service_history-1774688576705.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D80ec3fc707723f11b4a2e69ee0ec974f%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4415/20374415/docs_service_history-1774688576705.jpg?ixlib=js-3.8.0&auto=format&s=80ec3fc707723f11b4a2e69ee0ec974f not downloaded yet
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4415%252F20374415%252Fdamage_scratches-1774687343814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4415/20374415/damage_scratches-1774687343814.jpg not downloaded yet
2026-03-29 20:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_driver-1774687198608.jpg> (referer: None)
2026-03-29 20:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_passenger-1774687250940.jpg> (referer: None)
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca44590>
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_front_driver-1774687198608.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_driver-1774687198608.jpg saved to cache
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_driver-1774687220725.jpg> (referer: None)
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1b4d0>
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_rear_passenger-1774687250940.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_passenger-1774687250940.jpg saved to cache
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca45bd0>
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_rear_driver-1774687220725.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_driver-1774687220725.jpg saved to cache
2026-03-29 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_passenger-1774687242934.jpg> (referer: None)
2026-03-29 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4415/20374415/docs_service_history-1774688576705.jpg?ixlib=js-3.8.0&auto=format&s=80ec3fc707723f11b4a2e69ee0ec974f> (referer: None)
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2614d0>
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Fexterior_front_passenger-1774687242934.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_passenger-1774687242934.jpg saved to cache
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca19e10>
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4415%252F20374415%252Fdocs_service_history-1774688576705.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D80ec3fc707723f11b4a2e69ee0ec974f') HTTP/1.1" 204 0
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4415/20374415/docs_service_history-1774688576705.jpg?ixlib=js-3.8.0&auto=format&s=80ec3fc707723f11b4a2e69ee0ec974f saved to cache
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10030504.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1152&page=32&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4415/20374415/interior_dashboard-1774687811544.jpg> (referer: None)
2026-03-29 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4415/20374415/interior_boot-1774691136849.jpg> (referer: None)
2026-03-29 20:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b880a3-4125-5164-a1c9-399e200b50f4 with identifier: 10030504
2026-03-29 20:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b880a3-4125-5164-a1c9-399e200b50f4 with scrape type 1
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9b880a3-4125-5164-a1c9-399e200b50f4
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Fexterior_front_driver-1774008212388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_front_driver-1774008212388.jpg not downloaded yet
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Fexterior_rear_driver-1774008254375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_rear_driver-1774008254375.jpg not downloaded yet
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 18037733
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20357003
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20419987
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20487473
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20355479
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720355479%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [motorway.uk] INFO: Scrape type for 20355479: 1
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2614d0>
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4415%252F20374415%252Finterior_dashboard-1774687811544.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4415/20374415/interior_dashboard-1774687811544.jpg saved to cache
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc6590>
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4415%252F20374415%252Finterior_boot-1774691136849.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4415/20374415/interior_boot-1774691136849.jpg saved to cache
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Fexterior_front_passenger-1774008217660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_front_passenger-1774008217660.jpg not downloaded yet
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 12517194
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 17744204
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20209184
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 9654966
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 17811380
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20487082
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20405903
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20335691
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720335691%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [motorway.uk] INFO: Scrape type for 20335691: 1
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Fexterior_rear_passenger-1774008242162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_rear_passenger-1774008242162.jpg not downloaded yet
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20492519
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 19185025
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20473857
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 18463422
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20432038
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720432038%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [motorway.uk] INFO: Scrape type for 20432038: 1
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0504%252F10030504%252F10030504-interior_front_seats-default-1774703427840.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0504/10030504/10030504-interior_front_seats-default-1774703427840.jpg not downloaded yet
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20466969
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 16001492
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20488676
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 19668749
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20386402
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20456408
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 20144250
2026-03-29 20:32:01 [motorway.uk] INFO: Found listing with ID: 19436717
2026-03-29 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719436717%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [motorway.uk] INFO: Scrape type for 19436717: 1
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0504%252F10030504%252Finterior_rear_seats-1774008434042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0504/10030504/interior_rear_seats-1774008434042.jpg not downloaded yet
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20482913
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20165260
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720165260%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [motorway.uk] INFO: Scrape type for 20165260: 1
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Finterior_dashboard-1774008382997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/interior_dashboard-1774008382997.jpg not downloaded yet
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20420247
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20458630
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458630%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [motorway.uk] INFO: Scrape type for 20458630: 1
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4415/20374415/damage_scratches-1774687343814.jpg> (referer: None)
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Finstrument_cluster-1774008454273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/instrument_cluster-1774008454273.jpg not downloaded yet
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 18085024
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718085024%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [motorway.uk] INFO: Scrape type for 18085024: 1
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0504%252F10030504%252Finterior_boot-1774008404190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0504/10030504/interior_boot-1774008404190.jpg not downloaded yet
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20484226
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 15574359
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20469502
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469502%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [motorway.uk] INFO: Scrape type for 20469502: 1
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0504%252F10030504%252F10030504-damage_scratches-modified-1774691062099.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0504/10030504/10030504-damage_scratches-modified-1774691062099.jpeg not downloaded yet
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17982437.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20453801
2026-03-29 20:32:02 [motorway.uk] INFO: Found listing with ID: 20497569
2026-03-29 20:32:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec802d0>
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4415%252F20374415%252Fdamage_scratches-1774687343814.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4415/20374415/damage_scratches-1774687343814.jpg saved to cache
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61ade0d1-24c1-51f3-a6d2-a75beccbe839 with identifier: 17982437
2026-03-29 20:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839 with scrape type 1
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_front_driver-1774696182365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_driver-1774696182365.jpg not downloaded yet
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_rear_driver-1774696250404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_driver-1774696250404.jpg not downloaded yet
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_rear_driver-1774008254375.jpg> (referer: None)
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_front_passenger-1774696206224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_passenger-1774696206224.jpg not downloaded yet
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_front_passenger-1774008217660.jpg> (referer: None)
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_rear_passenger-1774696235532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_passenger-1774696235532.jpg not downloaded yet
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Finterior_front_seats-1774696860400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/interior_front_seats-1774696860400.jpg not downloaded yet
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Finterior_rear_seats-1774696804326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/interior_rear_seats-1774696804326.jpg not downloaded yet
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Finterior_dashboard-1774696841240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/interior_dashboard-1774696841240.jpg not downloaded yet
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Finstrument_cluster-1774697019332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/instrument_cluster-1774697019332.jpg not downloaded yet
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Finterior_boot-1774696713435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/interior_boot-1774696713435.jpg not downloaded yet
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e066250>
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b880a3-4125-5164-a1c9-399e200b50f4/f9b880a3-4125-5164-a1c9-399e200b50f4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Fexterior_rear_driver-1774008254375.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_rear_driver-1774008254375.jpg saved to cache
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9b880a3-4125-5164-a1c9-399e200b50f4
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b62d0>
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b880a3-4125-5164-a1c9-399e200b50f4/f9b880a3-4125-5164-a1c9-399e200b50f4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0504%252F10030504%252Fexterior_front_passenger-1774008217660.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0504/10030504/exterior_front_passenger-1774008217660.jpg saved to cache
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9b880a3-4125-5164-a1c9-399e200b50f4
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Fdamage_scratches-1774696286923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/damage_scratches-1774696286923.jpg not downloaded yet
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_driver-1774696182365.jpg> (referer: None)
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4415/20374415/interior_front_seats-1774687709114.jpg> (referer: None)
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4415/20374415/interior_rear_seats-1774687730415.jpg> (referer: None)
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0504/10030504/10030504-damage_scratches-modified-1774691062099.jpeg> (referer: None)
2026-03-29 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_passenger-1774696206224.jpg> (referer: None)
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d504ad0>
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_front_driver-1774696182365.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_driver-1774696182365.jpg saved to cache
2026-03-29 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea9f1d0>
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4415%252F20374415%252Finterior_front_seats-1774687709114.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4415/20374415/interior_front_seats-1774687709114.jpg saved to cache
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d012110>
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4415%252F20374415%252Finterior_rear_seats-1774687730415.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4415/20374415/interior_rear_seats-1774687730415.jpg saved to cache
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec
2026-03-29 20:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a567e9ec-9b70-5723-b07f-c0b60fdac4ec, skipping ID generation
2026-03-29 20:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec with scrape type 1
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a567e9ec-9b70-5723-b07f-c0b60fdac4ec sending to next pipeline
2026-03-29 20:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a567e9ec-9b70-5723-b07f-c0b60fdac4ec, identifier: 20374415
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf4d510>
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b880a3-4125-5164-a1c9-399e200b50f4/f9b880a3-4125-5164-a1c9-399e200b50f4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0504%252F10030504%252F10030504-damage_scratches-modified-1774691062099.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0504/10030504/10030504-damage_scratches-modified-1774691062099.jpeg saved to cache
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9b880a3-4125-5164-a1c9-399e200b50f4
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d011a10>
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_front_passenger-1774696206224.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_passenger-1774696206224.jpg saved to cache
2026-03-29 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a567e9ec-9b70-5723-b07f-c0b60fdac4ec with identifier: 20374415
2026-03-29 20:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a567e9ec-9b70-5723-b07f-c0b60fdac4ec with identifier: 20374415
2026-03-29 20:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a567e9ec-9b70-5723-b07f-c0b60fdac4ec with identifier: 20374415 to the API
2026-03-29 20:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4415/20374415/interior_rear_seats-1774687730415.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a567e9ec-9b70-5723-b07f-c0b60fdac4ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PH13 ONS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20374415',
'listing': 'auction',
'location': 'Neath Port Talbot Principle Area Neath',
'make': 'Mercedes',
'model': 'GLC',
'odometer': 71913,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387768,
'Height': 2164,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_driver-1774687198608.jpg',
'Width': 2885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202859,
'Height': 2203,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_driver-1774687220725.jpg',
'Width': 2937},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2446039,
'Height': 2834,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_front_passenger-1774687242934.jpg',
'Width': 3778},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1789003,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4415/20374415/exterior_rear_passenger-1774687250940.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3583582,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4415/20374415/interior_front_seats-1774687709114.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3741696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4415/20374415/interior_rear_seats-1774687730415.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1685434,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4415/20374415/interior_dashboard-1774687811544.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3345740,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4415/20374415/interior_boot-1774691136849.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7575251,
'Height': 4373,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4415/20374415/docs_service_history-1774688576705.jpg?ixlib=js-3.8.0&auto=format&s=80ec3fc707723f11b4a2e69ee0ec974f',
'Width': 2992},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a567e9ec-9b70-5723-b07f-c0b60fdac4ec/a567e9ec-9b70-5723-b07f-c0b60fdac4ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4650033,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4415/20374415/damage_scratches-1774687343814.jpg',
'Width': 4032}],
'price': 20742,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLC 300 AMG Line Prem D 4M A',
'transmission': 'automatic',
'trim': '300 AMG Line Prem D 4M A',
'vin': 'W1N2539192F897191',
'year': 2021}
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720374415%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [motorway.uk] INFO: Saving data for 20374415: {'created_time': 1774816324.138845, 'last_price_update_time': 1774816324.138856, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20374415') HTTP/1.1" 204 0
2026-03-29 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2437/17982437/damage_scratches-1774696286923.jpg> (referer: None)
2026-03-29 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2437/17982437/interior_boot-1774696713435.jpg> (referer: None)
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9ac890>
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Fdamage_scratches-1774696286923.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/damage_scratches-1774696286923.jpg saved to cache
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce58450>
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Finterior_boot-1774696713435.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/interior_boot-1774696713435.jpg saved to cache
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18355209.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16662751.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2437/17982437/interior_rear_seats-1774696804326.jpg> (referer: None)
2026-03-29 20:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264 with identifier: 18355209
2026-03-29 20:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264 with scrape type 1
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_front_driver-1774708778569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_front_driver-1774708778569.jpg not downloaded yet
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_rear_driver-1774708776449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_rear_driver-1774708776449.jpg not downloaded yet
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_front_passenger-1774708779011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_front_passenger-1774708779011.jpg not downloaded yet
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_rear_passenger-1774708779950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_rear_passenger-1774708779950.jpg not downloaded yet
2026-03-29 20:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9738c574-357b-58f9-b1d6-484b7b1566f3 with identifier: 16662751
2026-03-29 20:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9738c574-357b-58f9-b1d6-484b7b1566f3 with scrape type 1
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_front_driver-1774348868386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_driver-1774348868386.jpg not downloaded yet
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5209%252F18355209%252Finterior_front_seats-1774709226040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5209/18355209/interior_front_seats-1774709226040.jpg not downloaded yet
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_rear_driver-1774348884614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_driver-1774348884614.jpg not downloaded yet
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21e250>
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Finterior_rear_seats-1774696804326.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/interior_rear_seats-1774696804326.jpg saved to cache
2026-03-29 20:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5209%252F18355209%252Finterior_rear_seats-1774709180829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5209/18355209/interior_rear_seats-1774709180829.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_front_passenger-1774348913408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_passenger-1774348913408.jpg not downloaded yet
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2437/17982437/instrument_cluster-1774697019332.jpg> (referer: None)
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Finterior_dashboard-1774709190651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/interior_dashboard-1774709190651.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_rear_passenger-1774348898598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_passenger-1774348898598.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Finstrument_cluster-1774709215949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/instrument_cluster-1774709215949.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Finterior_front_seats-1774701237472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/interior_front_seats-1774701237472.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5209%252F18355209%252Finterior_boot-1774709178438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5209/18355209/interior_boot-1774709178438.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Finterior_rear_seats-1774701258271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/interior_rear_seats-1774701258271.jpg not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5209%252F18355209%252Fdocs_service_history-1774709744373.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3b4e92f3d282bcda25aef46ba704d3e%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5209/18355209/docs_service_history-1774709744373.jpg?ixlib=js-3.8.0&auto=format&s=a3b4e92f3d282bcda25aef46ba704d3e not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Finterior_dashboard-1774701391086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/interior_dashboard-1774701391086.jpg not downloaded yet
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d115390>
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Finstrument_cluster-1774697019332.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/instrument_cluster-1774697019332.jpg saved to cache
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_driver-1774696250404.jpg> (referer: None)
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Finterior_boot-1774701374162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/interior_boot-1774701374162.jpg not downloaded yet
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2437/17982437/interior_front_seats-1774696860400.jpg> (referer: None)
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2751%252F16662751%252Fdocs_service_history-1774701651241.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D07f54b409e2adec77a3e3578f8994acd%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2751/16662751/docs_service_history-1774701651241.jpg?ixlib=js-3.8.0&auto=format&s=07f54b409e2adec77a3e3578f8994acd not downloaded yet
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Fdamage_scratches-1774349010069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/damage_scratches-1774349010069.jpg not downloaded yet
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_passenger-1774696235532.jpg> (referer: None)
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2437/17982437/interior_dashboard-1774696841240.jpg> (referer: None)
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0504/10030504/interior_boot-1774008404190.jpg> (referer: None)
2026-03-29 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5209/18355209/interior_rear_seats-1774709180829.jpg> (referer: None)
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e085b90>
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_rear_driver-1774696250404.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_driver-1774696250404.jpg saved to cache
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d78bad0>
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2437%252F17982437%252Finterior_front_seats-1774696860400.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2437/17982437/interior_front_seats-1774696860400.jpg saved to cache
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d118ed0>
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Fexterior_rear_passenger-1774696235532.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_passenger-1774696235532.jpg saved to cache
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d13cc50>
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2437%252F17982437%252Finterior_dashboard-1774696841240.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2437/17982437/interior_dashboard-1774696841240.jpg saved to cache
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839
2026-03-29 20:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61ade0d1-24c1-51f3-a6d2-a75beccbe839, skipping ID generation
2026-03-29 20:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839 with scrape type 1
2026-03-29 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61ade0d1-24c1-51f3-a6d2-a75beccbe839 sending to next pipeline
2026-03-29 20:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 61ade0d1-24c1-51f3-a6d2-a75beccbe839, identifier: 17982437
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e03d450>
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b880a3-4125-5164-a1c9-399e200b50f4/f9b880a3-4125-5164-a1c9-399e200b50f4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0504%252F10030504%252Finterior_boot-1774008404190.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0504/10030504/interior_boot-1774008404190.jpg saved to cache
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9b880a3-4125-5164-a1c9-399e200b50f4
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb02350>
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5209%252F18355209%252Finterior_rear_seats-1774709180829.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5209/18355209/interior_rear_seats-1774709180829.jpg saved to cache
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 61ade0d1-24c1-51f3-a6d2-a75beccbe839 with identifier: 17982437
2026-03-29 20:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 61ade0d1-24c1-51f3-a6d2-a75beccbe839 with identifier: 17982437
2026-03-29 20:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 61ade0d1-24c1-51f3-a6d2-a75beccbe839 with identifier: 17982437 to the API
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2437/17982437/interior_dashboard-1774696841240.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '61ade0d1-24c1-51f3-a6d2-a75beccbe839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BC12 EER',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17982437',
'listing': 'auction',
'location': 'Medway Rochester',
'make': 'Audi',
'model': 'A1',
'odometer': 109000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1047494,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_driver-1774696182365.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884552,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_driver-1774696250404.jpg',
'Width': 3098},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1363575,
'Height': 2620,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_front_passenger-1774696206224.jpg',
'Width': 3493},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1307706,
'Height': 2561,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2437/17982437/exterior_rear_passenger-1774696235532.jpg',
'Width': 3415},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2587579,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2437/17982437/interior_front_seats-1774696860400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2573047,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2437/17982437/interior_rear_seats-1774696804326.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3224557,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2437/17982437/interior_dashboard-1774696841240.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2452159,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2437/17982437/instrument_cluster-1774697019332.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2683659,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2437/17982437/interior_boot-1774696713435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ade0d1-24c1-51f3-a6d2-a75beccbe839/61ade0d1-24c1-51f3-a6d2-a75beccbe839_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2461932,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2437/17982437/damage_scratches-1774696286923.jpg',
'Width': 4032}],
'price': 3811,
'price_includes_vat': False,
'registration_date': '2012-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport TFSI S-A',
'transmission': 'automatic',
'trim': 'Sport TFSI S-A',
'vin': 'WAUZZZ8X1DB017433',
'year': 2012}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717982437%27 HTTP/1.1" 200 None
2026-03-29 20:32:06 [motorway.uk] INFO: Saving data for 17982437: {'created_time': 1774816326.601177, 'last_price_update_time': 1774816326.601189, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17982437') HTTP/1.1" 204 0
2026-03-29 20:32:06 [scrapy.extensions.logstats] INFO: Crawled 330 pages (at 18 pages/min), scraped 291 items (at 12 items/min)
2026-03-29 20:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 287MiB
2026-03-29 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5209/18355209/docs_service_history-1774709744373.jpg?ixlib=js-3.8.0&auto=format&s=a3b4e92f3d282bcda25aef46ba704d3e> (referer: None)
2026-03-29 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2751/16662751/interior_dashboard-1774701391086.jpg> (referer: None)
2026-03-29 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2751/16662751/damage_scratches-1774349010069.jpg> (referer: None)
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacce10>
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5209%252F18355209%252Fdocs_service_history-1774709744373.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3b4e92f3d282bcda25aef46ba704d3e') HTTP/1.1" 204 0
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5209/18355209/docs_service_history-1774709744373.jpg?ixlib=js-3.8.0&auto=format&s=a3b4e92f3d282bcda25aef46ba704d3e saved to cache
2026-03-29 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14443515.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9d6bd0>
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Finterior_dashboard-1774701391086.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/interior_dashboard-1774701391086.jpg saved to cache
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7fe10>
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Fdamage_scratches-1774349010069.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/damage_scratches-1774349010069.jpg saved to cache
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed443338-4645-5dfb-8843-a123e1019d04 with identifier: 14443515
2026-03-29 20:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed443338-4645-5dfb-8843-a123e1019d04 with scrape type 1
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_front_driver-1774697217646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_driver-1774697217646.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_rear_driver-1774697278993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_driver-1774697278993.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_front_passenger-1774697905630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_passenger-1774697905630.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_rear_passenger-1774697324682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_passenger-1774697324682.jpg not downloaded yet
2026-03-29 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2751/16662751/docs_service_history-1774701651241.jpg?ixlib=js-3.8.0&auto=format&s=07f54b409e2adec77a3e3578f8994acd> (referer: None)
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3515%252F14443515%252Finterior_front_seats-1774695942841.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3515/14443515/interior_front_seats-1774695942841.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3515%252F14443515%252Finterior_rear_seats-1774695883017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3515/14443515/interior_rear_seats-1774695883017.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Finterior_dashboard-1774695925078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/interior_dashboard-1774695925078.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Finstrument_cluster-1774695826555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/instrument_cluster-1774695826555.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3515%252F14443515%252Finterior_boot-1774695931846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3515/14443515/interior_boot-1774695931846.jpg not downloaded yet
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3515%252F14443515%252Fdocs_service_history-1774699923475.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8bd2ad1287a1b2317beafd69a2a3565d%27 HTTP/1.1" 200 None
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3515/14443515/docs_service_history-1774699923475.jpg?ixlib=js-3.8.0&auto=format&s=8bd2ad1287a1b2317beafd69a2a3565d not downloaded yet
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cece250>
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2751%252F16662751%252Fdocs_service_history-1774701651241.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D07f54b409e2adec77a3e3578f8994acd') HTTP/1.1" 204 0
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2751/16662751/docs_service_history-1774701651241.jpg?ixlib=js-3.8.0&auto=format&s=07f54b409e2adec77a3e3578f8994acd saved to cache
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5209/18355209/interior_boot-1774709178438.jpg> (referer: None)
2026-03-29 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2751/16662751/interior_rear_seats-1774701258271.jpg> (referer: None)
2026-03-29 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2751/16662751/interior_front_seats-1774701237472.jpg> (referer: None)
2026-03-29 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2751/16662751/interior_boot-1774701374162.jpg> (referer: None)
2026-03-29 20:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_passenger-1774348898598.jpg> (referer: None)
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec3b650>
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5209%252F18355209%252Finterior_boot-1774709178438.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5209/18355209/interior_boot-1774709178438.jpg saved to cache
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c405a10>
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Finterior_rear_seats-1774701258271.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/interior_rear_seats-1774701258271.jpg saved to cache
2026-03-29 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e929510>
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Finterior_front_seats-1774701237472.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/interior_front_seats-1774701237472.jpg saved to cache
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2d66d0>
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2751%252F16662751%252Finterior_boot-1774701374162.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2751/16662751/interior_boot-1774701374162.jpg saved to cache
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22c650>
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_rear_passenger-1774348898598.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_passenger-1774348898598.jpg saved to cache
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5209/18355209/instrument_cluster-1774709215949.jpg> (referer: None)
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_passenger-1774697324682.jpg> (referer: None)
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca44f50>
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Finstrument_cluster-1774709215949.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/instrument_cluster-1774709215949.jpg saved to cache
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca8b190>
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_rear_passenger-1774697324682.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_passenger-1774697324682.jpg saved to cache
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3515/14443515/interior_boot-1774695931846.jpg> (referer: None)
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3515/14443515/instrument_cluster-1774695826555.jpg> (referer: None)
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_passenger-1774697905630.jpg> (referer: None)
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3515/14443515/docs_service_history-1774699923475.jpg?ixlib=js-3.8.0&auto=format&s=8bd2ad1287a1b2317beafd69a2a3565d> (referer: None)
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c257e50>
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3515%252F14443515%252Finterior_boot-1774695931846.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3515/14443515/interior_boot-1774695931846.jpg saved to cache
2026-03-29 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1188&page=33&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b5490>
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Finstrument_cluster-1774695826555.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/instrument_cluster-1774695826555.jpg saved to cache
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d144690>
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_front_passenger-1774697905630.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_passenger-1774697905630.jpg saved to cache
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e929190>
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3515%252F14443515%252Fdocs_service_history-1774699923475.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8bd2ad1287a1b2317beafd69a2a3565d') HTTP/1.1" 204 0
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3515/14443515/docs_service_history-1774699923475.jpg?ixlib=js-3.8.0&auto=format&s=8bd2ad1287a1b2317beafd69a2a3565d saved to cache
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20484945
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484945%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20484945: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 14357475
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20175875
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20016415
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720016415%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20016415: 1
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3515/14443515/interior_dashboard-1774695925078.jpg> (referer: None)
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 18975319
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20492267
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20435647
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20487216
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487216%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20487216: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 18947501
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20381015
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381015%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20381015: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20482805
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 9373677
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20339850
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720339850%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20339850: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20478886
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478886%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20478886: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 19640893
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719640893%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 19640893: 1
2026-03-29 20:32:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d05ce90>
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Finterior_dashboard-1774695925078.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/interior_dashboard-1774695925078.jpg saved to cache
2026-03-29 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 16034385
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20490883
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 18780849
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 18169442
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20467557
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20172298
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720172298%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 20172298: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20481158
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20009659
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 19320604
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719320604%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 19320604: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20473409
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20388349
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 14416221
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714416221%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 14416221: 1
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_driver-1774697278993.jpg> (referer: None)
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 15999217
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715999217%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 15999217: 1
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20500662
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 19873015
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20398790
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 13687661
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 13044273
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 11047706
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 20388848
2026-03-29 20:32:09 [motorway.uk] INFO: Found listing with ID: 18340983
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718340983%27 HTTP/1.1" 200 None
2026-03-29 20:32:09 [motorway.uk] INFO: Scrape type for 18340983: 1
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_driver-1774697217646.jpg> (referer: None)
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3515/14443515/interior_rear_seats-1774695883017.jpg> (referer: None)
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_driver-1774348884614.jpg> (referer: None)
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5209/18355209/interior_dashboard-1774709190651.jpg> (referer: None)
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3515/14443515/interior_front_seats-1774695942841.jpg> (referer: None)
2026-03-29 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_passenger-1774348913408.jpg> (referer: None)
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c254ad0>
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_rear_driver-1774697278993.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_driver-1774697278993.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d556310>
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3515%252F14443515%252Fexterior_front_driver-1774697217646.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_driver-1774697217646.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16cbd0>
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3515%252F14443515%252Finterior_rear_seats-1774695883017.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3515/14443515/interior_rear_seats-1774695883017.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d101290>
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_rear_driver-1774348884614.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_driver-1774348884614.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d16e210>
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Finterior_dashboard-1774709190651.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/interior_dashboard-1774709190651.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c241050>
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3515%252F14443515%252Finterior_front_seats-1774695942841.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3515/14443515/interior_front_seats-1774695942841.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed443338-4645-5dfb-8843-a123e1019d04
2026-03-29 20:32:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed443338-4645-5dfb-8843-a123e1019d04, skipping ID generation
2026-03-29 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed443338-4645-5dfb-8843-a123e1019d04 with scrape type 1
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed443338-4645-5dfb-8843-a123e1019d04 sending to next pipeline
2026-03-29 20:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ed443338-4645-5dfb-8843-a123e1019d04, identifier: 14443515
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c21f650>
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_front_passenger-1774348913408.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_passenger-1774348913408.jpg saved to cache
2026-03-29 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ed443338-4645-5dfb-8843-a123e1019d04 with identifier: 14443515
2026-03-29 20:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ed443338-4645-5dfb-8843-a123e1019d04 with identifier: 14443515
2026-03-29 20:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ed443338-4645-5dfb-8843-a123e1019d04 with identifier: 14443515 to the API
2026-03-29 20:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3515/14443515/interior_front_seats-1774695942841.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ed443338-4645-5dfb-8843-a123e1019d04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC16 LPY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14443515',
'listing': 'auction',
'location': 'Greater London Dagenham',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 63705,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397235,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_driver-1774697217646.jpg',
'Width': 3174},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1337478,
'Height': 2291,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_driver-1774697278993.jpg',
'Width': 3054},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1367044,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_front_passenger-1774697905630.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1711897,
'Height': 2747,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3515/14443515/exterior_rear_passenger-1774697324682.jpg',
'Width': 3662},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4455990,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3515/14443515/interior_front_seats-1774695942841.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4121634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3515/14443515/interior_rear_seats-1774695883017.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3237541,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3515/14443515/interior_dashboard-1774695925078.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1621527,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3515/14443515/instrument_cluster-1774695826555.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3963067,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3515/14443515/interior_boot-1774695931846.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed443338-4645-5dfb-8843-a123e1019d04/ed443338-4645-5dfb-8843-a123e1019d04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1358077,
'Height': 5533,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3515/14443515/docs_service_history-1774699923475.jpg?ixlib=js-3.8.0&auto=format&s=8bd2ad1287a1b2317beafd69a2a3565d',
'Width': 7377}],
'price': 5155,
'price_includes_vat': False,
'registration_date': '2016-06-09',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Tekna DiG-T',
'transmission': 'manual',
'trim': 'Tekna DiG-T',
'vin': 'SJNFEAJ11U1726188',
'year': 2016}
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714443515%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [motorway.uk] INFO: Saving data for 14443515: {'created_time': 1774816331.278068, 'last_price_update_time': 1774816331.278079, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14443515') HTTP/1.1" 204 0
2026-03-29 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20441126.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a21d9c-13fd-558d-9135-64e718b6b2af with identifier: 20441126
2026-03-29 20:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a21d9c-13fd-558d-9135-64e718b6b2af with scrape type 1
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_front_driver-1774453304384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_driver-1774453304384.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_rear_driver-1774453335486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_driver-1774453335486.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_front_passenger-1774453367938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_passenger-1774453367938.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_rear_passenger-1774453347058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_passenger-1774453347058.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1126%252F20441126%252Finterior_front_seats-1774707014376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1126/20441126/interior_front_seats-1774707014376.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1126%252F20441126%252Finterior_rear_seats-1774708087147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1126/20441126/interior_rear_seats-1774708087147.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Finterior_dashboard-1774707136649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/interior_dashboard-1774707136649.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1126%252F20441126%252Finterior_boot-1774707511794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1126/20441126/interior_boot-1774707511794.jpg not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1126%252F20441126%252Fdocs_service_history-1774708704357.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1dbe0ca8aeb086c0d96d4fdb4feb861f%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708704357.jpg?ixlib=js-3.8.0&auto=format&s=1dbe0ca8aeb086c0d96d4fdb4feb861f not downloaded yet
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1126%252F20441126%252Fdocs_service_history-1774708713162.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8be3c04809f3e616b424e00e174dbb5%27 HTTP/1.1" 200 None
2026-03-29 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708713162.jpg?ixlib=js-3.8.0&auto=format&s=d8be3c04809f3e616b424e00e174dbb5 not downloaded yet
2026-03-29 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20355479.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff42eb5a-0c61-50a4-94f4-a75e24b0c22c with identifier: 20355479
2026-03-29 20:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c with scrape type 1
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5479%252F20355479%252Fexterior_front_driver-1774284790500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_driver-1774284790500.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Fexterior_rear_driver-1774698666501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_driver-1774698666501.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5479%252F20355479%252Fexterior_front_passenger-1774284784964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_passenger-1774284784964.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Fexterior_rear_passenger-1774698700566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_passenger-1774698700566.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5479%252F20355479%252Finterior_front_seats-1774285130565.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5479/20355479/interior_front_seats-1774285130565.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Finterior_rear_seats-1774698713420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/interior_rear_seats-1774698713420.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Finterior_dashboard-1774698742294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/interior_dashboard-1774698742294.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5479%252F20355479%252Finterior_boot-1774285090282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5479/20355479/interior_boot-1774285090282.jpg not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5479%252F20355479%252Fdocs_service_history-1774285461451.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D78f0b6961a3bf1f24a938967738ba735%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285461451.jpg?ixlib=js-3.8.0&auto=format&s=78f0b6961a3bf1f24a938967738ba735 not downloaded yet
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5479%252F20355479%252Fdocs_service_history-1774285500741.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db4379169f11c4c33745649c42524ca38%27 HTTP/1.1" 200 None
2026-03-29 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285500741.jpg?ixlib=js-3.8.0&auto=format&s=b4379169f11c4c33745649c42524ca38 not downloaded yet
2026-03-29 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708713162.jpg?ixlib=js-3.8.0&auto=format&s=d8be3c04809f3e616b424e00e174dbb5> (referer: None)
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1e950>
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1126%252F20441126%252Fdocs_service_history-1774708713162.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8be3c04809f3e616b424e00e174dbb5') HTTP/1.1" 204 0
2026-03-29 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708713162.jpg?ixlib=js-3.8.0&auto=format&s=d8be3c04809f3e616b424e00e174dbb5 saved to cache
2026-03-29 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19912396.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285500741.jpg?ixlib=js-3.8.0&auto=format&s=b4379169f11c4c33745649c42524ca38> (referer: None)
2026-03-29 20:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c with identifier: 19912396
2026-03-29 20:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c with scrape type 2
2026-03-29 20:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c, identifier: 19912396
2026-03-29 20:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c with identifier: 19912396
2026-03-29 20:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c with identifier: 19912396
2026-03-29 20:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c with identifier: 19912396 to the API
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19912396.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f0fd2fc2-673c-5a37-9df5-9f0e9c830b7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'V19 RGO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19912396',
'listing': 'auction',
'location': 'Stockton-on-Tees Stockton-on-Tees',
'make': 'Kia',
'model': 'Sportage',
'odometer': 14479,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 16026,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage GT-LINE ISG 4X4 S-A',
'transmission': 'automatic',
'trim': 'GT-LINE ISG 4X4 S-A',
'vin': 'U5YPK816WLL784222',
'year': 2019}
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719912396%27 HTTP/1.1" 200 None
2026-03-29 20:32:14 [motorway.uk] INFO: Saving data for 19912396: {'auction_closing_time': 1774884600.0, 'created_time': 1774471042.428449, 'last_price_update_time': 1774816334.957265}
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19912396') HTTP/1.1" 204 0
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea54390>
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5479%252F20355479%252Fdocs_service_history-1774285500741.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db4379169f11c4c33745649c42524ca38') HTTP/1.1" 204 0
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285500741.jpg?ixlib=js-3.8.0&auto=format&s=b4379169f11c4c33745649c42524ca38 saved to cache
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5479/20355479/interior_boot-1774285090282.jpg> (referer: None)
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071d90>
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5479%252F20355479%252Finterior_boot-1774285090282.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5479/20355479/interior_boot-1774285090282.jpg saved to cache
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285461451.jpg?ixlib=js-3.8.0&auto=format&s=78f0b6961a3bf1f24a938967738ba735> (referer: None)
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24bc10>
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5479%252F20355479%252Fdocs_service_history-1774285461451.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D78f0b6961a3bf1f24a938967738ba735') HTTP/1.1" 204 0
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285461451.jpg?ixlib=js-3.8.0&auto=format&s=78f0b6961a3bf1f24a938967738ba735 saved to cache
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5479/20355479/interior_dashboard-1774698742294.jpg> (referer: None)
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec29790>
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Finterior_dashboard-1774698742294.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/interior_dashboard-1774698742294.jpg saved to cache
2026-03-29 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5479/20355479/interior_rear_seats-1774698713420.jpg> (referer: None)
2026-03-29 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5479/20355479/interior_front_seats-1774285130565.jpg> (referer: None)
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5ab3d0>
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Finterior_rear_seats-1774698713420.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/interior_rear_seats-1774698713420.jpg saved to cache
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec2aa90>
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5479%252F20355479%252Finterior_front_seats-1774285130565.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5479/20355479/interior_front_seats-1774285130565.jpg saved to cache
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_passenger-1774698700566.jpg> (referer: None)
2026-03-29 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_passenger-1774284784964.jpg> (referer: None)
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea56f50>
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Fexterior_rear_passenger-1774698700566.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_passenger-1774698700566.jpg saved to cache
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d756ed0>
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5479%252F20355479%252Fexterior_front_passenger-1774284784964.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_passenger-1774284784964.jpg saved to cache
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_driver-1774698666501.jpg> (referer: None)
2026-03-29 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_driver-1774284790500.jpg> (referer: None)
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24aed0>
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5479%252F20355479%252Fexterior_rear_driver-1774698666501.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_driver-1774698666501.jpg saved to cache
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e070890>
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5479%252F20355479%252Fexterior_front_driver-1774284790500.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_driver-1774284790500.jpg saved to cache
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c
2026-03-29 20:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff42eb5a-0c61-50a4-94f4-a75e24b0c22c, skipping ID generation
2026-03-29 20:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c with scrape type 1
2026-03-29 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff42eb5a-0c61-50a4-94f4-a75e24b0c22c sending to next pipeline
2026-03-29 20:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ff42eb5a-0c61-50a4-94f4-a75e24b0c22c, identifier: 20355479
2026-03-29 20:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ff42eb5a-0c61-50a4-94f4-a75e24b0c22c with identifier: 20355479
2026-03-29 20:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ff42eb5a-0c61-50a4-94f4-a75e24b0c22c with identifier: 20355479
2026-03-29 20:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ff42eb5a-0c61-50a4-94f4-a75e24b0c22c with identifier: 20355479 to the API
2026-03-29 20:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_driver-1774284790500.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ff42eb5a-0c61-50a4-94f4-a75e24b0c22c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV18 YVP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20355479',
'listing': 'auction',
'location': 'Suffolk Stowmarket',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 78316,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 980430,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_driver-1774284790500.jpg',
'Width': 3130},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 830469,
'Height': 2093,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_driver-1774698666501.jpg',
'Width': 2791},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820457,
'Height': 2137,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5479/20355479/exterior_front_passenger-1774284784964.jpg',
'Width': 2849},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 900916,
'Height': 2016,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5479/20355479/exterior_rear_passenger-1774698700566.jpg',
'Width': 2688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195417,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5479/20355479/interior_front_seats-1774285130565.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2262804,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5479/20355479/interior_rear_seats-1774698713420.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623547,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5479/20355479/interior_dashboard-1774698742294.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1877857,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5479/20355479/interior_boot-1774285090282.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 922570,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285461451.jpg?ixlib=js-3.8.0&auto=format&s=78f0b6961a3bf1f24a938967738ba735',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff42eb5a-0c61-50a4-94f4-a75e24b0c22c/ff42eb5a-0c61-50a4-94f4-a75e24b0c22c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 936482,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5479/20355479/docs_service_history-1774285500741.jpg?ixlib=js-3.8.0&auto=format&s=b4379169f11c4c33745649c42524ca38',
'Width': 2880}],
'price': 6575,
'price_includes_vat': False,
'registration_date': '2018-07-13',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Karoq SE TSI',
'transmission': 'manual',
'trim': 'SE TSI',
'vin': 'TMBKP7NU3J5040019',
'year': 2018}
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720355479%27 HTTP/1.1" 200 None
2026-03-29 20:32:17 [motorway.uk] INFO: Saving data for 20355479: {'created_time': 1774816337.221815, 'last_price_update_time': 1774816337.221826, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20355479') HTTP/1.1" 204 0
2026-03-29 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708704357.jpg?ixlib=js-3.8.0&auto=format&s=1dbe0ca8aeb086c0d96d4fdb4feb861f> (referer: None)
2026-03-29 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1126/20441126/interior_boot-1774707511794.jpg> (referer: None)
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec65110>
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1126%252F20441126%252Fdocs_service_history-1774708704357.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1dbe0ca8aeb086c0d96d4fdb4feb861f') HTTP/1.1" 204 0
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708704357.jpg?ixlib=js-3.8.0&auto=format&s=1dbe0ca8aeb086c0d96d4fdb4feb861f saved to cache
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5a9e10>
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1126%252F20441126%252Finterior_boot-1774707511794.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1126/20441126/interior_boot-1774707511794.jpg saved to cache
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1126/20441126/interior_dashboard-1774707136649.jpg> (referer: None)
2026-03-29 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1126/20441126/interior_rear_seats-1774708087147.jpg> (referer: None)
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec65990>
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Finterior_dashboard-1774707136649.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/interior_dashboard-1774707136649.jpg saved to cache
2026-03-29 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e927550>
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1126%252F20441126%252Finterior_rear_seats-1774708087147.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1126/20441126/interior_rear_seats-1774708087147.jpg saved to cache
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1126/20441126/interior_front_seats-1774707014376.jpg> (referer: None)
2026-03-29 20:32:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ec66a10>
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1126%252F20441126%252Finterior_front_seats-1774707014376.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1126/20441126/interior_front_seats-1774707014376.jpg saved to cache
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_passenger-1774453367938.jpg> (referer: None)
2026-03-29 20:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_passenger-1774453347058.jpg> (referer: None)
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e071910>
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_front_passenger-1774453367938.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_passenger-1774453367938.jpg saved to cache
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469502.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce21390>
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_rear_passenger-1774453347058.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_passenger-1774453347058.jpg saved to cache
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48d8ac9a-031a-52ef-a0bc-820126844cb0 with identifier: 20469502
2026-03-29 20:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48d8ac9a-031a-52ef-a0bc-820126844cb0 with scrape type 1
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_front_driver-1774696417297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_driver-1774696417297.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_rear_driver-1774701804812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_driver-1774701804812.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_front_passenger-1774696418347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_passenger-1774696418347.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_rear_passenger-1774696468117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_passenger-1774696468117.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9502%252F20469502%252Finterior_front_seats-1774701873090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9502/20469502/interior_front_seats-1774701873090.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9502%252F20469502%252Finterior_rear_seats-1774697190918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9502/20469502/interior_rear_seats-1774697190918.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Finterior_dashboard-1774701894965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/interior_dashboard-1774701894965.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Finstrument_cluster-1774702002407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/instrument_cluster-1774702002407.jpg not downloaded yet
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9502%252F20469502%252Finterior_boot-1774701874135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9502/20469502/interior_boot-1774701874135.jpg not downloaded yet
2026-03-29 20:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_driver-1774453335486.jpg> (referer: None)
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9502%252F20469502%252Fdocs_service_history-1774701048253.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97c328bc0dfc1fc0faaeb4b1f9998fb2%27 HTTP/1.1" 200 None
2026-03-29 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9502/20469502/docs_service_history-1774701048253.jpg?ixlib=js-3.8.0&auto=format&s=97c328bc0dfc1fc0faaeb4b1f9998fb2 not downloaded yet
2026-03-29 20:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_driver-1774453304384.jpg> (referer: None)
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc4f10>
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_rear_driver-1774453335486.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_driver-1774453335486.jpg saved to cache
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d714b10>
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1126%252F20441126%252Fexterior_front_driver-1774453304384.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_driver-1774453304384.jpg saved to cache
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79a21d9c-13fd-558d-9135-64e718b6b2af
2026-03-29 20:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79a21d9c-13fd-558d-9135-64e718b6b2af, skipping ID generation
2026-03-29 20:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a21d9c-13fd-558d-9135-64e718b6b2af with scrape type 1
2026-03-29 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79a21d9c-13fd-558d-9135-64e718b6b2af sending to next pipeline
2026-03-29 20:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 79a21d9c-13fd-558d-9135-64e718b6b2af, identifier: 20441126
2026-03-29 20:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 79a21d9c-13fd-558d-9135-64e718b6b2af with identifier: 20441126
2026-03-29 20:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 79a21d9c-13fd-558d-9135-64e718b6b2af with identifier: 20441126
2026-03-29 20:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 79a21d9c-13fd-558d-9135-64e718b6b2af with identifier: 20441126 to the API
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_driver-1774453304384.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '79a21d9c-13fd-558d-9135-64e718b6b2af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP65 BFY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20441126',
'listing': 'auction',
'location': 'Pembrokeshire Narberth',
'make': 'Mitsubishi',
'model': 'Shogun',
'odometer': 105447,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2698105,
'Height': 2942,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_driver-1774453304384.jpg',
'Width': 3922},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2444361,
'Height': 2820,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_driver-1774453335486.jpg',
'Width': 3760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2516330,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_front_passenger-1774453367938.jpg',
'Width': 3514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2636402,
'Height': 2879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1126/20441126/exterior_rear_passenger-1774453347058.jpg',
'Width': 3838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4238063,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1126/20441126/interior_front_seats-1774707014376.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4059555,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1126/20441126/interior_rear_seats-1774708087147.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3284843,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1126/20441126/interior_dashboard-1774707136649.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2976722,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1126/20441126/interior_boot-1774707511794.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 908842,
'Height': 2626,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708704357.jpg?ixlib=js-3.8.0&auto=format&s=1dbe0ca8aeb086c0d96d4fdb4feb861f',
'Width': 3183},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a21d9c-13fd-558d-9135-64e718b6b2af/79a21d9c-13fd-558d-9135-64e718b6b2af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825928,
'Height': 3439,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1126/20441126/docs_service_history-1774708713162.jpg?ixlib=js-3.8.0&auto=format&s=d8be3c04809f3e616b424e00e174dbb5',
'Width': 4183}],
'price': 10339,
'price_includes_vat': False,
'registration_date': '2015-10-30',
'seats_number': None,
'seller_name': None,
'title': 'Mitsubishi Shogun SG3 DI-D LWB Auto',
'transmission': 'automatic',
'trim': 'SG3 DI-D LWB Auto',
'vin': 'JMALYV98WGJ600374',
'year': 2015}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441126%27 HTTP/1.1" 200 None
2026-03-29 20:32:19 [motorway.uk] INFO: Saving data for 20441126: {'created_time': 1774816339.79141, 'last_price_update_time': 1774816339.791423, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20441126') HTTP/1.1" 204 0
2026-03-29 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9502/20469502/docs_service_history-1774701048253.jpg?ixlib=js-3.8.0&auto=format&s=97c328bc0dfc1fc0faaeb4b1f9998fb2> (referer: None)
2026-03-29 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca678d0>
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9502%252F20469502%252Fdocs_service_history-1774701048253.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97c328bc0dfc1fc0faaeb4b1f9998fb2') HTTP/1.1" 204 0
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9502/20469502/docs_service_history-1774701048253.jpg?ixlib=js-3.8.0&auto=format&s=97c328bc0dfc1fc0faaeb4b1f9998fb2 saved to cache
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484945.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9502/20469502/interior_boot-1774701874135.jpg> (referer: None)
2026-03-29 20:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e7cda78-8c36-5b75-9661-b471653bdf62 with identifier: 20484945
2026-03-29 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e7cda78-8c36-5b75-9661-b471653bdf62 with scrape type 1
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_front_driver-1774699287744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_driver-1774699287744.jpg not downloaded yet
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e038dd0>
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9502%252F20469502%252Finterior_boot-1774701874135.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9502/20469502/interior_boot-1774701874135.jpg saved to cache
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_rear_driver-1774699268512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_driver-1774699268512.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_front_passenger-1774699241711.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_passenger-1774699241711.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_rear_passenger-1774699258884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_passenger-1774699258884.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4945%252F20484945%252Finterior_front_seats-1774699838126.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4945/20484945/interior_front_seats-1774699838126.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4945%252F20484945%252Finterior_rear_seats-1774699733102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4945/20484945/interior_rear_seats-1774699733102.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4945%252F20484945%252Finterior_dashboard-1774701052561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4945/20484945/interior_dashboard-1774701052561.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Finstrument_cluster-1774699801436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/instrument_cluster-1774699801436.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4945%252F20484945%252Finterior_boot-1774699785980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4945/20484945/interior_boot-1774699785980.jpg not downloaded yet
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4945%252F20484945%252Fdocs_service_history-1774771278983.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d621c81a34e53f29c3fde144a9c3c4d%27 HTTP/1.1" 200 None
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4945/20484945/docs_service_history-1774771278983.jpg?ixlib=js-3.8.0&auto=format&s=0d621c81a34e53f29c3fde144a9c3c4d not downloaded yet
2026-03-29 20:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9502/20469502/interior_dashboard-1774701894965.jpg> (referer: None)
2026-03-29 20:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9502/20469502/instrument_cluster-1774702002407.jpg> (referer: None)
2026-03-29 20:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9502/20469502/interior_rear_seats-1774697190918.jpg> (referer: None)
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacfd10>
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Finterior_dashboard-1774701894965.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/interior_dashboard-1774701894965.jpg saved to cache
2026-03-29 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cace250>
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Finstrument_cluster-1774702002407.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/instrument_cluster-1774702002407.jpg saved to cache
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb3b590>
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9502%252F20469502%252Finterior_rear_seats-1774697190918.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9502/20469502/interior_rear_seats-1774697190918.jpg saved to cache
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4945/20484945/docs_service_history-1774771278983.jpg?ixlib=js-3.8.0&auto=format&s=0d621c81a34e53f29c3fde144a9c3c4d> (referer: None)
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c189d0>
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4945%252F20484945%252Fdocs_service_history-1774771278983.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0d621c81a34e53f29c3fde144a9c3c4d') HTTP/1.1" 204 0
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4945/20484945/docs_service_history-1774771278983.jpg?ixlib=js-3.8.0&auto=format&s=0d621c81a34e53f29c3fde144a9c3c4d saved to cache
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4945/20484945/interior_boot-1774699785980.jpg> (referer: None)
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c214c50>
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4945%252F20484945%252Finterior_boot-1774699785980.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4945/20484945/interior_boot-1774699785980.jpg saved to cache
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4945/20484945/interior_rear_seats-1774699733102.jpg> (referer: None)
2026-03-29 20:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4945/20484945/interior_dashboard-1774701052561.jpg> (referer: None)
2026-03-29 20:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4945/20484945/instrument_cluster-1774699801436.jpg> (referer: None)
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d755510>
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4945%252F20484945%252Finterior_rear_seats-1774699733102.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4945/20484945/interior_rear_seats-1774699733102.jpg saved to cache
2026-03-29 20:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7560d0>
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4945%252F20484945%252Finterior_dashboard-1774701052561.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4945/20484945/interior_dashboard-1774701052561.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d11b690>
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Finstrument_cluster-1774699801436.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/instrument_cluster-1774699801436.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_passenger-1774699258884.jpg> (referer: None)
2026-03-29 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4945/20484945/interior_front_seats-1774699838126.jpg> (referer: None)
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d755f10>
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_rear_passenger-1774699258884.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_passenger-1774699258884.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7575d0>
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4945%252F20484945%252Finterior_front_seats-1774699838126.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4945/20484945/interior_front_seats-1774699838126.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_passenger-1774699241711.jpg> (referer: None)
2026-03-29 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_driver-1774699268512.jpg> (referer: None)
2026-03-29 20:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_driver-1774699287744.jpg> (referer: None)
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14c1b710>
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_front_passenger-1774699241711.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_passenger-1774699241711.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb3a850>
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_rear_driver-1774699268512.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_driver-1774699268512.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbdce90>
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4945%252F20484945%252Fexterior_front_driver-1774699287744.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_driver-1774699287744.jpg saved to cache
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e7cda78-8c36-5b75-9661-b471653bdf62
2026-03-29 20:32:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e7cda78-8c36-5b75-9661-b471653bdf62, skipping ID generation
2026-03-29 20:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e7cda78-8c36-5b75-9661-b471653bdf62 with scrape type 1
2026-03-29 20:32:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e7cda78-8c36-5b75-9661-b471653bdf62 sending to next pipeline
2026-03-29 20:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8e7cda78-8c36-5b75-9661-b471653bdf62, identifier: 20484945
2026-03-29 20:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8e7cda78-8c36-5b75-9661-b471653bdf62 with identifier: 20484945
2026-03-29 20:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8e7cda78-8c36-5b75-9661-b471653bdf62 with identifier: 20484945
2026-03-29 20:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8e7cda78-8c36-5b75-9661-b471653bdf62 with identifier: 20484945 to the API
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_driver-1774699287744.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8e7cda78-8c36-5b75-9661-b471653bdf62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN68 VEB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484945',
'listing': 'auction',
'location': 'Northamptonshire Northampton',
'make': 'MINI',
'model': 'Clubman',
'odometer': 73205,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2112061,
'Height': 2564,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_driver-1774699287744.jpg',
'Width': 3418},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102604,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_driver-1774699268512.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355023,
'Height': 2152,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_front_passenger-1774699241711.jpg',
'Width': 2869},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1844249,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4945/20484945/exterior_rear_passenger-1774699258884.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2813703,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4945/20484945/interior_front_seats-1774699838126.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2558135,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4945/20484945/interior_rear_seats-1774699733102.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2377099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4945/20484945/interior_dashboard-1774701052561.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626096,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4945/20484945/instrument_cluster-1774699801436.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3744940,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4945/20484945/interior_boot-1774699785980.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e7cda78-8c36-5b75-9661-b471653bdf62/8e7cda78-8c36-5b75-9661-b471653bdf62_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773281,
'Height': 2748,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4945/20484945/docs_service_history-1774771278983.jpg?ixlib=js-3.8.0&auto=format&s=0d621c81a34e53f29c3fde144a9c3c4d',
'Width': 2061}],
'price': 7083,
'price_includes_vat': False,
'registration_date': '2018-09-24',
'seats_number': None,
'seller_name': None,
'title': 'MINI Clubman Cooper',
'transmission': 'manual',
'trim': 'Cooper',
'vin': 'WMWJZ32010TP33484',
'year': 2018}
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484945%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [motorway.uk] INFO: Saving data for 20484945: {'created_time': 1774816343.549283, 'last_price_update_time': 1774816343.549296, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484945') HTTP/1.1" 204 0
2026-03-29 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18340983.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_passenger-1774696418347.jpg> (referer: None)
2026-03-29 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_passenger-1774696468117.jpg> (referer: None)
2026-03-29 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9502/20469502/interior_front_seats-1774701873090.jpg> (referer: None)
2026-03-29 20:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a92afc-5874-535b-bc34-2eb37ae98cce with identifier: 18340983
2026-03-29 20:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a92afc-5874-535b-bc34-2eb37ae98cce with scrape type 1
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_front_driver-1774702495679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_driver-1774702495679.jpg not downloaded yet
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_rear_driver-1774702512664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_driver-1774702512664.jpg not downloaded yet
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_front_passenger-1774702535696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_passenger-1774702535696.jpg not downloaded yet
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b1910>
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_front_passenger-1774696418347.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_passenger-1774696418347.jpg saved to cache
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1842d0>
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_rear_passenger-1774696468117.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_passenger-1774696468117.jpg saved to cache
2026-03-29 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca0d350>
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9502%252F20469502%252Finterior_front_seats-1774701873090.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9502/20469502/interior_front_seats-1774701873090.jpg saved to cache
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_rear_passenger-1774702519958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_passenger-1774702519958.jpg not downloaded yet
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0983%252F18340983%252Finterior_front_seats-1774702941942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0983/18340983/interior_front_seats-1774702941942.jpg not downloaded yet
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0983%252F18340983%252Finterior_rear_seats-1774702965942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0983/18340983/interior_rear_seats-1774702965942.jpg not downloaded yet
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Finterior_dashboard-1774702998229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/interior_dashboard-1774702998229.jpg not downloaded yet
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Finstrument_cluster-1774703024537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/instrument_cluster-1774703024537.jpg not downloaded yet
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0983%252F18340983%252Finterior_boot-1774703005049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0983/18340983/interior_boot-1774703005049.jpg not downloaded yet
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0983%252F18340983%252Fdocs_service_history-1774703159501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0af1bffa7b5d163688912893c799fcd2%27 HTTP/1.1" 200 None
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0983/18340983/docs_service_history-1774703159501.jpg?ixlib=js-3.8.0&auto=format&s=0af1bffa7b5d163688912893c799fcd2 not downloaded yet
2026-03-29 20:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_driver-1774701804812.jpg> (referer: None)
2026-03-29 20:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_driver-1774696417297.jpg> (referer: None)
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0205d0>
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_rear_driver-1774701804812.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_driver-1774701804812.jpg saved to cache
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d716910>
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9502%252F20469502%252Fexterior_front_driver-1774696417297.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_driver-1774696417297.jpg saved to cache
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48d8ac9a-031a-52ef-a0bc-820126844cb0
2026-03-29 20:32:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48d8ac9a-031a-52ef-a0bc-820126844cb0, skipping ID generation
2026-03-29 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48d8ac9a-031a-52ef-a0bc-820126844cb0 with scrape type 1
2026-03-29 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48d8ac9a-031a-52ef-a0bc-820126844cb0 sending to next pipeline
2026-03-29 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 48d8ac9a-031a-52ef-a0bc-820126844cb0, identifier: 20469502
2026-03-29 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 48d8ac9a-031a-52ef-a0bc-820126844cb0 with identifier: 20469502
2026-03-29 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 48d8ac9a-031a-52ef-a0bc-820126844cb0 with identifier: 20469502
2026-03-29 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 48d8ac9a-031a-52ef-a0bc-820126844cb0 with identifier: 20469502 to the API
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_driver-1774696417297.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '48d8ac9a-031a-52ef-a0bc-820126844cb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NM21 JVH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20469502',
'listing': 'auction',
'location': 'Tyne and Wear Newcastle upon Tyne',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 45695,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1926510,
'Height': 2914,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_driver-1774696417297.jpg',
'Width': 3885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1766491,
'Height': 2830,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_driver-1774701804812.jpg',
'Width': 3773},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1297565,
'Height': 2698,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_front_passenger-1774696418347.jpg',
'Width': 3597},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1940589,
'Height': 2987,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9502/20469502/exterior_rear_passenger-1774696468117.jpg',
'Width': 3982},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3552190,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9502/20469502/interior_front_seats-1774701873090.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3794701,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9502/20469502/interior_rear_seats-1774697190918.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928479,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9502/20469502/interior_dashboard-1774701894965.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3199641,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9502/20469502/instrument_cluster-1774702002407.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3874907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9502/20469502/interior_boot-1774701874135.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48d8ac9a-031a-52ef-a0bc-820126844cb0/48d8ac9a-031a-52ef-a0bc-820126844cb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2656299,
'Height': 2951,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9502/20469502/docs_service_history-1774701048253.jpg?ixlib=js-3.8.0&auto=format&s=97c328bc0dfc1fc0faaeb4b1f9998fb2',
'Width': 2015}],
'price': 10022,
'price_includes_vat': False,
'registration_date': '2021-06-15',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match TSI',
'transmission': 'manual',
'trim': 'Match TSI',
'vin': 'WVWZZZAWZMU027874',
'year': 2021}
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469502%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [motorway.uk] INFO: Saving data for 20469502: {'created_time': 1774816345.020239, 'last_price_update_time': 1774816345.020251, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20469502') HTTP/1.1" 204 0
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0983/18340983/docs_service_history-1774703159501.jpg?ixlib=js-3.8.0&auto=format&s=0af1bffa7b5d163688912893c799fcd2> (referer: None)
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_passenger-1774702519958.jpg> (referer: None)
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1be50>
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0983%252F18340983%252Fdocs_service_history-1774703159501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0af1bffa7b5d163688912893c799fcd2') HTTP/1.1" 204 0
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0983/18340983/docs_service_history-1774703159501.jpg?ixlib=js-3.8.0&auto=format&s=0af1bffa7b5d163688912893c799fcd2 saved to cache
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19320604.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2c5150>
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_rear_passenger-1774702519958.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_passenger-1774702519958.jpg saved to cache
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689d5bc5-3c93-5838-9295-a4db2823967c with identifier: 19320604
2026-03-29 20:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689d5bc5-3c93-5838-9295-a4db2823967c with scrape type 1
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0604%252F19320604%252Fexterior_front_driver-1774694595063.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0604/19320604/exterior_front_driver-1774694595063.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0604%252F19320604%252Fexterior_rear_driver-1774694609516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0604/19320604/exterior_rear_driver-1774694609516.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Fexterior_front_passenger-1774692847790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_front_passenger-1774692847790.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Fexterior_rear_passenger-1774692820041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_rear_passenger-1774692820041.jpg not downloaded yet
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0983/18340983/interior_boot-1774703005049.jpg> (referer: None)
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0604%252F19320604%252Finterior_front_seats-1774693486738.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0604/19320604/interior_front_seats-1774693486738.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0604%252F19320604%252Finterior_rear_seats-1774693379382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0604/19320604/interior_rear_seats-1774693379382.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Finterior_dashboard-1774693442215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/interior_dashboard-1774693442215.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Finstrument_cluster-1774693345737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/instrument_cluster-1774693345737.jpg not downloaded yet
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0604%252F19320604%252Finterior_boot-1774693479992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0604/19320604/interior_boot-1774693479992.jpg not downloaded yet
2026-03-29 20:32:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1f410>
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0983%252F18340983%252Finterior_boot-1774703005049.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0983/18340983/interior_boot-1774703005049.jpg saved to cache
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0604%252F19320604%252Fdocs_service_history-1774694121307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2233bfc4a81457209504910c0e8df7f8%27 HTTP/1.1" 200 None
2026-03-29 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0604/19320604/docs_service_history-1774694121307.jpg?ixlib=js-3.8.0&auto=format&s=2233bfc4a81457209504910c0e8df7f8 not downloaded yet
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0983/18340983/interior_dashboard-1774702998229.jpg> (referer: None)
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0983/18340983/instrument_cluster-1774703024537.jpg> (referer: None)
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0983/18340983/interior_rear_seats-1774702965942.jpg> (referer: None)
2026-03-29 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0604/19320604/docs_service_history-1774694121307.jpg?ixlib=js-3.8.0&auto=format&s=2233bfc4a81457209504910c0e8df7f8> (referer: None)
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce16ad0>
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Finterior_dashboard-1774702998229.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/interior_dashboard-1774702998229.jpg saved to cache
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_front_passenger-1774692847790.jpg> (referer: None)
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce17710>
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Finstrument_cluster-1774703024537.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/instrument_cluster-1774703024537.jpg saved to cache
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1d310>
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0983%252F18340983%252Finterior_rear_seats-1774702965942.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0983/18340983/interior_rear_seats-1774702965942.jpg saved to cache
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24f390>
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0604%252F19320604%252Fdocs_service_history-1774694121307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2233bfc4a81457209504910c0e8df7f8') HTTP/1.1" 204 0
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0604/19320604/docs_service_history-1774694121307.jpg?ixlib=js-3.8.0&auto=format&s=2233bfc4a81457209504910c0e8df7f8 saved to cache
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58d810>
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Fexterior_front_passenger-1774692847790.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_front_passenger-1774692847790.jpg saved to cache
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0604/19320604/interior_boot-1774693479992.jpg> (referer: None)
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8f150>
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0604%252F19320604%252Finterior_boot-1774693479992.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0604/19320604/interior_boot-1774693479992.jpg saved to cache
2026-03-29 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0604/19320604/instrument_cluster-1774693345737.jpg> (referer: None)
2026-03-29 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0604/19320604/interior_rear_seats-1774693379382.jpg> (referer: None)
2026-03-29 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0604/19320604/interior_dashboard-1774693442215.jpg> (referer: None)
2026-03-29 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0604/19320604/interior_front_seats-1774693486738.jpg> (referer: None)
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8e1d0>
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Finstrument_cluster-1774693345737.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/instrument_cluster-1774693345737.jpg saved to cache
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8f8d0>
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0604%252F19320604%252Finterior_rear_seats-1774693379382.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0604/19320604/interior_rear_seats-1774693379382.jpg saved to cache
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed81090>
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Finterior_dashboard-1774693442215.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/interior_dashboard-1774693442215.jpg saved to cache
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58c7d0>
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0604%252F19320604%252Finterior_front_seats-1774693486738.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0604/19320604/interior_front_seats-1774693486738.jpg saved to cache
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_rear_passenger-1774692820041.jpg> (referer: None)
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8e950>
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0604%252F19320604%252Fexterior_rear_passenger-1774692820041.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_rear_passenger-1774692820041.jpg saved to cache
2026-03-29 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0604/19320604/exterior_front_driver-1774694595063.jpg> (referer: None)
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d58c690>
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0604%252F19320604%252Fexterior_front_driver-1774694595063.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0604/19320604/exterior_front_driver-1774694595063.jpg saved to cache
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0983/18340983/interior_front_seats-1774702941942.jpg> (referer: None)
2026-03-29 20:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0604/19320604/exterior_rear_driver-1774694609516.jpg> (referer: None)
2026-03-29 20:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_passenger-1774702535696.jpg> (referer: None)
2026-03-29 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f097d0>
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0983%252F18340983%252Finterior_front_seats-1774702941942.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0983/18340983/interior_front_seats-1774702941942.jpg saved to cache
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1857d0>
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0604%252F19320604%252Fexterior_rear_driver-1774694609516.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0604/19320604/exterior_rear_driver-1774694609516.jpg saved to cache
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 689d5bc5-3c93-5838-9295-a4db2823967c
2026-03-29 20:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 689d5bc5-3c93-5838-9295-a4db2823967c, skipping ID generation
2026-03-29 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689d5bc5-3c93-5838-9295-a4db2823967c with scrape type 1
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 689d5bc5-3c93-5838-9295-a4db2823967c sending to next pipeline
2026-03-29 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 689d5bc5-3c93-5838-9295-a4db2823967c, identifier: 19320604
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc14f09250>
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_front_passenger-1774702535696.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_passenger-1774702535696.jpg saved to cache
2026-03-29 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 689d5bc5-3c93-5838-9295-a4db2823967c with identifier: 19320604
2026-03-29 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 689d5bc5-3c93-5838-9295-a4db2823967c with identifier: 19320604
2026-03-29 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 689d5bc5-3c93-5838-9295-a4db2823967c with identifier: 19320604 to the API
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0604/19320604/exterior_rear_driver-1774694609516.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '689d5bc5-3c93-5838-9295-a4db2823967c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF04 GEM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19320604',
'listing': 'auction',
'location': 'West Sussex Horsham',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 133000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1962235,
'Height': 2284,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0604/19320604/exterior_front_driver-1774694595063.jpg',
'Width': 3045},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1943287,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0604/19320604/exterior_rear_driver-1774694609516.jpg',
'Width': 3219},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1885436,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_front_passenger-1774692847790.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1899627,
'Height': 2496,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0604/19320604/exterior_rear_passenger-1774692820041.jpg',
'Width': 3328},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4564447,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0604/19320604/interior_front_seats-1774693486738.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4205787,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0604/19320604/interior_rear_seats-1774693379382.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3238444,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0604/19320604/interior_dashboard-1774693442215.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2737709,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0604/19320604/instrument_cluster-1774693345737.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4802036,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0604/19320604/interior_boot-1774693479992.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689d5bc5-3c93-5838-9295-a4db2823967c/689d5bc5-3c93-5838-9295-a4db2823967c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248553,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0604/19320604/docs_service_history-1774694121307.jpg?ixlib=js-3.8.0&auto=format&s=2233bfc4a81457209504910c0e8df7f8',
'Width': 1179}],
'price': 7051,
'price_includes_vat': False,
'registration_date': '2019-06-24',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-Roc SE TDI',
'transmission': 'manual',
'trim': 'SE TDI',
'vin': 'WVGZZZA1ZKV133468',
'year': 2019}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719320604%27 HTTP/1.1" 200 None
2026-03-29 20:32:29 [motorway.uk] INFO: Saving data for 19320604: {'created_time': 1774816349.02939, 'last_price_update_time': 1774816349.029401, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19320604') HTTP/1.1" 204 0
2026-03-29 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_driver-1774702495679.jpg> (referer: None)
2026-03-29 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_driver-1774702512664.jpg> (referer: None)
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24ebd0>
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_front_driver-1774702495679.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_driver-1774702495679.jpg saved to cache
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2f8e50>
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0983%252F18340983%252Fexterior_rear_driver-1774702512664.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_driver-1774702512664.jpg saved to cache
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5a92afc-5874-535b-bc34-2eb37ae98cce
2026-03-29 20:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5a92afc-5874-535b-bc34-2eb37ae98cce, skipping ID generation
2026-03-29 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a92afc-5874-535b-bc34-2eb37ae98cce with scrape type 1
2026-03-29 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5a92afc-5874-535b-bc34-2eb37ae98cce sending to next pipeline
2026-03-29 20:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b5a92afc-5874-535b-bc34-2eb37ae98cce, identifier: 18340983
2026-03-29 20:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b5a92afc-5874-535b-bc34-2eb37ae98cce with identifier: 18340983
2026-03-29 20:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b5a92afc-5874-535b-bc34-2eb37ae98cce with identifier: 18340983
2026-03-29 20:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b5a92afc-5874-535b-bc34-2eb37ae98cce with identifier: 18340983 to the API
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_driver-1774702512664.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b5a92afc-5874-535b-bc34-2eb37ae98cce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EN69 PXK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18340983',
'listing': 'auction',
'location': 'South Lanarkshire Glasgow',
'make': 'Ford',
'model': 'Focus',
'odometer': 53600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757930,
'Height': 2535,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_driver-1774702495679.jpg',
'Width': 3380},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1966586,
'Height': 2569,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_driver-1774702512664.jpg',
'Width': 3425},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2313871,
'Height': 2785,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_front_passenger-1774702535696.jpg',
'Width': 3713},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1899715,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0983/18340983/exterior_rear_passenger-1774702519958.jpg',
'Width': 3299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3589730,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0983/18340983/interior_front_seats-1774702941942.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3022648,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0983/18340983/interior_rear_seats-1774702965942.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2079340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0983/18340983/interior_dashboard-1774702998229.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2208275,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0983/18340983/instrument_cluster-1774703024537.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4462648,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0983/18340983/interior_boot-1774703005049.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a92afc-5874-535b-bc34-2eb37ae98cce/b5a92afc-5874-535b-bc34-2eb37ae98cce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412066,
'Height': 1719,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0983/18340983/docs_service_history-1774703159501.jpg?ixlib=js-3.8.0&auto=format&s=0af1bffa7b5d163688912893c799fcd2',
'Width': 2362}],
'price': 12176,
'price_includes_vat': False,
'registration_date': '2020-02-06',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST Ecoblue',
'transmission': 'manual',
'trim': 'ST Ecoblue',
'vin': 'WF0NXXGCHNKP05403',
'year': 2020}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718340983%27 HTTP/1.1" 200 None
2026-03-29 20:32:29 [motorway.uk] INFO: Saving data for 18340983: {'created_time': 1774816349.835966, 'last_price_update_time': 1774816349.835977, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18340983') HTTP/1.1" 204 0
2026-03-29 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5209/18355209/interior_front_seats-1774709226040.jpg> (referer: None)
2026-03-29 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_driver-1774348868386.jpg> (referer: None)
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24e190>
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5209%252F18355209%252Finterior_front_seats-1774709226040.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5209/18355209/interior_front_seats-1774709226040.jpg saved to cache
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15999217.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31c6d0>
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2751%252F16662751%252Fexterior_front_driver-1774348868386.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_driver-1774348868386.jpg saved to cache
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9738c574-357b-58f9-b1d6-484b7b1566f3
2026-03-29 20:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9738c574-357b-58f9-b1d6-484b7b1566f3, skipping ID generation
2026-03-29 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9738c574-357b-58f9-b1d6-484b7b1566f3 with scrape type 1
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9738c574-357b-58f9-b1d6-484b7b1566f3 sending to next pipeline
2026-03-29 20:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9738c574-357b-58f9-b1d6-484b7b1566f3, identifier: 16662751
2026-03-29 20:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9738c574-357b-58f9-b1d6-484b7b1566f3 with identifier: 16662751
2026-03-29 20:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9738c574-357b-58f9-b1d6-484b7b1566f3 with identifier: 16662751
2026-03-29 20:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9738c574-357b-58f9-b1d6-484b7b1566f3 with identifier: 16662751 to the API
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_driver-1774348868386.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '9738c574-357b-58f9-b1d6-484b7b1566f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FY21 VGJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16662751',
'listing': 'auction',
'location': 'Edinburgh Edinburgh',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 11385,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1822472,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_driver-1774348868386.jpg',
'Width': 3262},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1481110,
'Height': 2344,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_driver-1774348884614.jpg',
'Width': 3125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443330,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_front_passenger-1774348913408.jpg',
'Width': 3639},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870146,
'Height': 2551,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2751/16662751/exterior_rear_passenger-1774348898598.jpg',
'Width': 3401},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3538589,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2751/16662751/interior_front_seats-1774701237472.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3058575,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2751/16662751/interior_rear_seats-1774701258271.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1861083,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2751/16662751/interior_dashboard-1774701391086.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4740266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2751/16662751/interior_boot-1774701374162.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670849,
'Height': 1459,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2751/16662751/docs_service_history-1774701651241.jpg?ixlib=js-3.8.0&auto=format&s=07f54b409e2adec77a3e3578f8994acd',
'Width': 4133},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9738c574-357b-58f9-b1d6-484b7b1566f3/9738c574-357b-58f9-b1d6-484b7b1566f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3944207,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2751/16662751/damage_scratches-1774349010069.jpg',
'Width': 4032}],
'price': 14259,
'price_includes_vat': False,
'registration_date': '2021-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki SX4 S-CROSS SZ-T B-JET MHEV A',
'transmission': 'automatic',
'trim': 'S-CROSS SZ-T B-JET MHEV A',
'vin': 'TSMJYAD2S00823428',
'year': 2021}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716662751%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [motorway.uk] INFO: Saving data for 16662751: {'created_time': 1774816350.639865, 'last_price_update_time': 1774816350.639877, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16662751') HTTP/1.1" 204 0
2026-03-29 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb8dd2d-6621-5344-bec0-2959f74777bc with identifier: 15999217
2026-03-29 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb8dd2d-6621-5344-bec0-2959f74777bc with scrape type 1
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Fexterior_front_driver-1774537821109.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_front_driver-1774537821109.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Fexterior_rear_driver-1774537806687.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_rear_driver-1774537806687.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Fexterior_front_passenger-1774537724897.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_front_passenger-1774537724897.jpeg not downloaded yet
2026-03-29 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_rear_passenger-1774708779950.jpg> (referer: None)
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Fexterior_rear_passenger-1774537783606.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_rear_passenger-1774537783606.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9217%252F15999217%252Finterior_front_seats-1774538368925.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9217/15999217/interior_front_seats-1774538368925.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9217%252F15999217%252Finterior_rear_seats-1774537906738.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9217/15999217/interior_rear_seats-1774537906738.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Finterior_dashboard-1774538012206.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/interior_dashboard-1774538012206.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Finstrument_cluster-1774538012113.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/instrument_cluster-1774538012113.jpeg not downloaded yet
2026-03-29 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_front_passenger-1774708779011.jpg> (referer: None)
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9217%252F15999217%252Finterior_boot-1774537961484.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9217/15999217/interior_boot-1774537961484.jpeg not downloaded yet
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9217%252F15999217%252Fdocs_service_history-1774620380850.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D089f297da11d4adda6024d8df1bfaff2%27 HTTP/1.1" 200 None
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9217/15999217/docs_service_history-1774620380850.jpeg?ixlib=js-3.8.0&auto=format&s=089f297da11d4adda6024d8df1bfaff2 not downloaded yet
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d28dd50>
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_rear_passenger-1774708779950.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_rear_passenger-1774708779950.jpg saved to cache
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e928a50>
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_front_passenger-1774708779011.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_front_passenger-1774708779011.jpg saved to cache
2026-03-29 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_rear_driver-1774708776449.jpg> (referer: None)
2026-03-29 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_rear_driver-1774537806687.jpeg> (referer: None)
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc02810>
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264/84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5209%252F18355209%252Fexterior_rear_driver-1774708776449.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5209/18355209/exterior_rear_driver-1774708776449.jpg saved to cache
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84d8bfef-c0eb-5d0b-b1c2-2d8e784c6264
2026-03-29 20:32:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.318(s), this was the 1st time calling it.
2026-03-29 20:32:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.087545985214652 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e9297d0>
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Fexterior_rear_driver-1774537806687.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_rear_driver-1774537806687.jpeg saved to cache
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9217/15999217/docs_service_history-1774620380850.jpeg?ixlib=js-3.8.0&auto=format&s=089f297da11d4adda6024d8df1bfaff2> (referer: None)
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1c650>
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9217%252F15999217%252Fdocs_service_history-1774620380850.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D089f297da11d4adda6024d8df1bfaff2') HTTP/1.1" 204 0
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9217/15999217/docs_service_history-1774620380850.jpeg?ixlib=js-3.8.0&auto=format&s=089f297da11d4adda6024d8df1bfaff2 saved to cache
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9217/15999217/interior_boot-1774537961484.jpeg> (referer: None)
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:26 15:12:37\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d021910>
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9217%252F15999217%252Finterior_boot-1774537961484.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9217/15999217/interior_boot-1774537961484.jpeg saved to cache
2026-03-29 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9217/15999217/instrument_cluster-1774538012113.jpeg> (referer: None)
2026-03-29 20:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1224&page=34&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:26 15:11:17\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cf1ec10>
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Finstrument_cluster-1774538012113.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/instrument_cluster-1774538012113.jpeg saved to cache
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19861645
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20152688
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 18699505
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20455511
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19242613
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 17909162
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 8203355
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20378089
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720378089%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 20378089: 1
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20299221
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 18086482
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19449183
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20485669
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20451319
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20410678
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 13676396
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 2387574
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 13149221
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20498874
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720498874%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 20498874: 1
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19958948
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20435928
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20487335
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20279875
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 11436867
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20385406
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19712537
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 17056470
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19080843
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719080843%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 19080843: 1
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20261314
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720261314%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 20261314: 1
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19037322
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 10154809
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710154809%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 10154809: 1
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 17587362
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20488866
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20475825
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475825%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 20475825: 1
2026-03-29 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9217/15999217/interior_dashboard-1774538012206.jpeg> (referer: None)
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20485471
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 19631185
2026-03-29 20:32:32 [motorway.uk] INFO: Found listing with ID: 20482587
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482587%27 HTTP/1.1" 200 None
2026-03-29 20:32:32 [motorway.uk] INFO: Scrape type for 20482587: 1
2026-03-29 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_rear_passenger-1774537783606.jpeg> (referer: None)
2026-03-29 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9217/15999217/interior_rear_seats-1774537906738.jpeg> (referer: None)
2026-03-29 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9217/15999217/interior_front_seats-1774538368925.jpeg> (referer: None)
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:26 15:13:14\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d023190>
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Finterior_dashboard-1774538012206.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/interior_dashboard-1774538012206.jpeg saved to cache
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca25510>
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9217%252F15999217%252Fexterior_rear_passenger-1774537783606.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9217/15999217/exterior_rear_passenger-1774537783606.jpeg saved to cache
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:26 15:11:42\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ed62890>
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9217%252F15999217%252Finterior_rear_seats-1774537906738.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9217/15999217/interior_rear_seats-1774537906738.jpeg saved to cache
2026-03-29 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:26 15:19:23\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce67510>
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb8dd2d-6621-5344-bec0-2959f74777bc/2eb8dd2d-6621-5344-bec0-2959f74777bc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9217%252F15999217%252Finterior_front_seats-1774538368925.jpeg') HTTP/1.1" 204 0
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9217/15999217/interior_front_seats-1774538368925.jpeg saved to cache
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eb8dd2d-6621-5344-bec0-2959f74777bc
2026-03-29 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14416221.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f with identifier: 14416221
2026-03-29 20:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f with scrape type 1
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_front_driver-1774700939597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_driver-1774700939597.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_rear_driver-1774700986812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_driver-1774700986812.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_front_passenger-1774700971585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_passenger-1774700971585.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_rear_passenger-1774700974758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_passenger-1774700974758.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6221%252F14416221%252Finterior_front_seats-1774701029630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6221/14416221/interior_front_seats-1774701029630.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6221%252F14416221%252Finterior_rear_seats-1774701220937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6221/14416221/interior_rear_seats-1774701220937.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Finterior_dashboard-1774701153134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/interior_dashboard-1774701153134.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Finstrument_cluster-1774717626961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/instrument_cluster-1774717626961.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6221%252F14416221%252Finterior_boot-1774701184671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6221/14416221/interior_boot-1774701184671.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6221%252F14416221%252Fdocs_service_history-1774707179917.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6213d2ef8f8e0b66bc18ada751178b5d%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6221/14416221/docs_service_history-1774707179917.jpg?ixlib=js-3.8.0&auto=format&s=6213d2ef8f8e0b66bc18ada751178b5d not downloaded yet
2026-03-29 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19640893.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c9a94e-7c25-5334-93c9-3c004843b1d0 with identifier: 19640893
2026-03-29 20:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c9a94e-7c25-5334-93c9-3c004843b1d0 with scrape type 1
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_front_driver-1774684557011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_driver-1774684557011.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_rear_driver-1774684612012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_driver-1774684612012.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_front_passenger-1774684645147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_passenger-1774684645147.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_rear_passenger-1774684579918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_passenger-1774684579918.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0893%252F19640893%252Finterior_front_seats-1774686287997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0893/19640893/interior_front_seats-1774686287997.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0893%252F19640893%252Finterior_rear_seats-1774686105536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0893/19640893/interior_rear_seats-1774686105536.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Finterior_dashboard-1774686127164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/interior_dashboard-1774686127164.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Finstrument_cluster-1774686199005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/instrument_cluster-1774686199005.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0893%252F19640893%252Finterior_boot-1774686161869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0893/19640893/interior_boot-1774686161869.jpg not downloaded yet
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0893%252F19640893%252Fdocs_service_history-1774686484404.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D42d0d956cfcfa7a924e73fcc6a872ad4%27 HTTP/1.1" 200 None
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0893/19640893/docs_service_history-1774686484404.jpg?ixlib=js-3.8.0&auto=format&s=42d0d956cfcfa7a924e73fcc6a872ad4 not downloaded yet
2026-03-29 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6221/14416221/docs_service_history-1774707179917.jpg?ixlib=js-3.8.0&auto=format&s=6213d2ef8f8e0b66bc18ada751178b5d> (referer: None)
2026-03-29 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cade750>
2026-03-29 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6221%252F14416221%252Fdocs_service_history-1774707179917.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6213d2ef8f8e0b66bc18ada751178b5d') HTTP/1.1" 204 0
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6221/14416221/docs_service_history-1774707179917.jpg?ixlib=js-3.8.0&auto=format&s=6213d2ef8f8e0b66bc18ada751178b5d saved to cache
2026-03-29 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0893/19640893/docs_service_history-1774686484404.jpg?ixlib=js-3.8.0&auto=format&s=42d0d956cfcfa7a924e73fcc6a872ad4> (referer: None)
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d161b50>
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0893%252F19640893%252Fdocs_service_history-1774686484404.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D42d0d956cfcfa7a924e73fcc6a872ad4') HTTP/1.1" 204 0
2026-03-29 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0893/19640893/docs_service_history-1774686484404.jpg?ixlib=js-3.8.0&auto=format&s=42d0d956cfcfa7a924e73fcc6a872ad4 saved to cache
2026-03-29 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0893/19640893/interior_boot-1774686161869.jpg> (referer: None)
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d5a8390>
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0893%252F19640893%252Finterior_boot-1774686161869.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0893/19640893/interior_boot-1774686161869.jpg saved to cache
2026-03-29 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0893/19640893/instrument_cluster-1774686199005.jpg> (referer: None)
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d161c10>
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Finstrument_cluster-1774686199005.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/instrument_cluster-1774686199005.jpg saved to cache
2026-03-29 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0893/19640893/interior_dashboard-1774686127164.jpg> (referer: None)
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca19790>
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Finterior_dashboard-1774686127164.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/interior_dashboard-1774686127164.jpg saved to cache
2026-03-29 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0893/19640893/interior_rear_seats-1774686105536.jpg> (referer: None)
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cea88d0>
2026-03-29 20:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0893%252F19640893%252Finterior_rear_seats-1774686105536.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0893/19640893/interior_rear_seats-1774686105536.jpg saved to cache
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20295392.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8fb43ea-7549-5f12-885d-6cfd375a3483 with identifier: 20295392
2026-03-29 20:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8fb43ea-7549-5f12-885d-6cfd375a3483 with scrape type 1
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_front_driver-1774698844388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_driver-1774698844388.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_rear_driver-1774698864747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_driver-1774698864747.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_front_passenger-1774698907086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_passenger-1774698907086.jpg not downloaded yet
2026-03-29 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0893/19640893/interior_front_seats-1774686287997.jpg> (referer: None)
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_rear_passenger-1774698913808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_passenger-1774698913808.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Finterior_front_seats-1774700355123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/interior_front_seats-1774700355123.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Finterior_rear_seats-1774699525175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/interior_rear_seats-1774699525175.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Finterior_dashboard-1774700421420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/interior_dashboard-1774700421420.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Finstrument_cluster-1774699799164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/instrument_cluster-1774699799164.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Finterior_boot-1774699467365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/interior_boot-1774699467365.jpg not downloaded yet
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Fdamage_missing_trims-1774708999667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/damage_missing_trims-1774708999667.jpg not downloaded yet
2026-03-29 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d249510>
2026-03-29 20:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0893%252F19640893%252Finterior_front_seats-1774686287997.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0893/19640893/interior_front_seats-1774686287997.jpg saved to cache
2026-03-29 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_passenger-1774684579918.jpg> (referer: None)
2026-03-29 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_driver-1774698864747.jpg> (referer: None)
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecce10>
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_rear_passenger-1774684579918.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_passenger-1774684579918.jpg saved to cache
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cecc0d0>
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_rear_driver-1774698864747.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_driver-1774698864747.jpg saved to cache
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5392/20295392/damage_missing_trims-1774708999667.jpg> (referer: None)
2026-03-29 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5392/20295392/interior_boot-1774699467365.jpg> (referer: None)
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cbea550>
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Fdamage_missing_trims-1774708999667.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/damage_missing_trims-1774708999667.jpg saved to cache
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e976690>
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Finterior_boot-1774699467365.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/interior_boot-1774699467365.jpg saved to cache
2026-03-29 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5392/20295392/instrument_cluster-1774699799164.jpg> (referer: None)
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d24b190>
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Finstrument_cluster-1774699799164.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/instrument_cluster-1774699799164.jpg saved to cache
2026-03-29 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5392/20295392/interior_rear_seats-1774699525175.jpg> (referer: None)
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c693510>
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Finterior_rear_seats-1774699525175.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/interior_rear_seats-1774699525175.jpg saved to cache
2026-03-29 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5392/20295392/interior_front_seats-1774700355123.jpg> (referer: None)
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1bed0>
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5392%252F20295392%252Finterior_front_seats-1774700355123.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5392/20295392/interior_front_seats-1774700355123.jpg saved to cache
2026-03-29 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5392/20295392/interior_dashboard-1774700421420.jpg> (referer: None)
2026-03-29 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_passenger-1774698913808.jpg> (referer: None)
2026-03-29 20:32:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c691c10>
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Finterior_dashboard-1774700421420.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/interior_dashboard-1774700421420.jpg saved to cache
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca1b290>
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_rear_passenger-1774698913808.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_passenger-1774698913808.jpg saved to cache
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_driver-1774698844388.jpg> (referer: None)
2026-03-29 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_passenger-1774698907086.jpg> (referer: None)
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c22f2d0>
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_front_driver-1774698844388.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_driver-1774698844388.jpg saved to cache
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c2406d0>
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5392%252F20295392%252Fexterior_front_passenger-1774698907086.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_passenger-1774698907086.jpg saved to cache
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8fb43ea-7549-5f12-885d-6cfd375a3483
2026-03-29 20:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8fb43ea-7549-5f12-885d-6cfd375a3483, skipping ID generation
2026-03-29 20:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8fb43ea-7549-5f12-885d-6cfd375a3483 with scrape type 1
2026-03-29 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8fb43ea-7549-5f12-885d-6cfd375a3483 sending to next pipeline
2026-03-29 20:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d8fb43ea-7549-5f12-885d-6cfd375a3483, identifier: 20295392
2026-03-29 20:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d8fb43ea-7549-5f12-885d-6cfd375a3483 with identifier: 20295392
2026-03-29 20:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d8fb43ea-7549-5f12-885d-6cfd375a3483 with identifier: 20295392
2026-03-29 20:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d8fb43ea-7549-5f12-885d-6cfd375a3483 with identifier: 20295392 to the API
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_passenger-1774698907086.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd8fb43ea-7549-5f12-885d-6cfd375a3483',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YG70 ORU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20295392',
'listing': 'auction',
'location': 'Hertfordshire Stevenage',
'make': 'BMW',
'model': 'M1',
'odometer': 25915,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1575042,
'Height': 1937,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_driver-1774698844388.jpg',
'Width': 2582},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1169471,
'Height': 1725,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_driver-1774698864747.jpg',
'Width': 2300},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1400426,
'Height': 1964,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_front_passenger-1774698907086.jpg',
'Width': 2618},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1006667,
'Height': 1640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5392/20295392/exterior_rear_passenger-1774698913808.jpg',
'Width': 2187},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3882881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5392/20295392/interior_front_seats-1774700355123.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3966901,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5392/20295392/interior_rear_seats-1774699525175.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3219000,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5392/20295392/interior_dashboard-1774700421420.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1401470,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5392/20295392/instrument_cluster-1774699799164.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4526884,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5392/20295392/interior_boot-1774699467365.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8fb43ea-7549-5f12-885d-6cfd375a3483/d8fb43ea-7549-5f12-885d-6cfd375a3483_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3210383,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5392/20295392/damage_missing_trims-1774708999667.jpg',
'Width': 4032}],
'price': 23616,
'price_includes_vat': False,
'registration_date': '2021-02-22',
'seats_number': None,
'seller_name': None,
'title': 'BMW M135i xDrive Auto',
'transmission': 'automatic',
'trim': '35i xDrive Auto',
'vin': 'WBA7L120607H30575',
'year': 2021}
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720295392%27 HTTP/1.1" 200 None
2026-03-29 20:32:40 [motorway.uk] INFO: Saving data for 20295392: {'created_time': 1774816360.36231, 'last_price_update_time': 1774816360.362322, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20295392') HTTP/1.1" 204 0
2026-03-29 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_driver-1774684612012.jpg> (referer: None)
2026-03-29 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_passenger-1774684645147.jpg> (referer: None)
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8ca10>
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_rear_driver-1774684612012.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_driver-1774684612012.jpg saved to cache
2026-03-29 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cc02910>
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_front_passenger-1774684645147.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_passenger-1774684645147.jpg saved to cache
2026-03-29 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6221/14416221/interior_boot-1774701184671.jpg> (referer: None)
2026-03-29 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_driver-1774684557011.jpg> (referer: None)
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cece250>
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6221%252F14416221%252Finterior_boot-1774701184671.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6221/14416221/interior_boot-1774701184671.jpg saved to cache
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c240790>
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0893%252F19640893%252Fexterior_front_driver-1774684557011.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_driver-1774684557011.jpg saved to cache
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6c9a94e-7c25-5334-93c9-3c004843b1d0
2026-03-29 20:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6c9a94e-7c25-5334-93c9-3c004843b1d0, skipping ID generation
2026-03-29 20:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c9a94e-7c25-5334-93c9-3c004843b1d0 with scrape type 1
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6c9a94e-7c25-5334-93c9-3c004843b1d0 sending to next pipeline
2026-03-29 20:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f6c9a94e-7c25-5334-93c9-3c004843b1d0, identifier: 19640893
2026-03-29 20:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f6c9a94e-7c25-5334-93c9-3c004843b1d0 with identifier: 19640893
2026-03-29 20:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f6c9a94e-7c25-5334-93c9-3c004843b1d0 with identifier: 19640893
2026-03-29 20:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f6c9a94e-7c25-5334-93c9-3c004843b1d0 with identifier: 19640893 to the API
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_driver-1774684557011.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f6c9a94e-7c25-5334-93c9-3c004843b1d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FT61 NXK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19640893',
'listing': 'auction',
'location': 'Northamptonshire Kettering',
'make': 'Ford',
'model': 'Ka',
'odometer': 90500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1683842,
'Height': 2737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_driver-1774684557011.jpg',
'Width': 3649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115963,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_driver-1774684612012.jpg',
'Width': 3599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1639582,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_front_passenger-1774684645147.jpg',
'Width': 3370},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1542373,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0893/19640893/exterior_rear_passenger-1774684579918.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3432423,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0893/19640893/interior_front_seats-1774686287997.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5185480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0893/19640893/interior_rear_seats-1774686105536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3393827,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0893/19640893/interior_dashboard-1774686127164.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3060995,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0893/19640893/instrument_cluster-1774686199005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3955068,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0893/19640893/interior_boot-1774686161869.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9a94e-7c25-5334-93c9-3c004843b1d0/f6c9a94e-7c25-5334-93c9-3c004843b1d0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4363995,
'Height': 3475,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0893/19640893/docs_service_history-1774686484404.jpg?ixlib=js-3.8.0&auto=format&s=42d0d956cfcfa7a924e73fcc6a872ad4',
'Width': 3206}],
'price': 337,
'price_includes_vat': False,
'registration_date': '2012-01-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ka Edge',
'transmission': 'manual',
'trim': 'Edge',
'vin': 'WF0UXXLTRUCB37348',
'year': 2012}
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719640893%27 HTTP/1.1" 200 None
2026-03-29 20:32:41 [motorway.uk] INFO: Saving data for 19640893: {'created_time': 1774816361.659779, 'last_price_update_time': 1774816361.659789, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19640893') HTTP/1.1" 204 0
2026-03-29 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6221/14416221/instrument_cluster-1774717626961.jpg> (referer: None)
2026-03-29 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6221/14416221/interior_dashboard-1774701153134.jpg> (referer: None)
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d2250>
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Finstrument_cluster-1774717626961.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/instrument_cluster-1774717626961.jpg saved to cache
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c216090>
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Finterior_dashboard-1774701153134.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/interior_dashboard-1774701153134.jpg saved to cache
2026-03-29 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6221/14416221/interior_front_seats-1774701029630.jpg> (referer: None)
2026-03-29 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6221/14416221/interior_rear_seats-1774701220937.jpg> (referer: None)
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0d3310>
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6221%252F14416221%252Finterior_front_seats-1774701029630.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6221/14416221/interior_front_seats-1774701029630.jpg saved to cache
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce8f490>
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6221%252F14416221%252Finterior_rear_seats-1774701220937.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6221/14416221/interior_rear_seats-1774701220937.jpg saved to cache
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_passenger-1774700974758.jpg> (referer: None)
2026-03-29 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_passenger-1774700971585.jpg> (referer: None)
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c214c50>
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_rear_passenger-1774700974758.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_passenger-1774700974758.jpg saved to cache
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c215390>
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_front_passenger-1774700971585.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_passenger-1774700971585.jpg saved to cache
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_driver-1774700939597.jpg> (referer: None)
2026-03-29 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_driver-1774700986812.jpg> (referer: None)
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d7eca10>
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_front_driver-1774700939597.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_driver-1774700939597.jpg saved to cache
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d31fb50>
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6221%252F14416221%252Fexterior_rear_driver-1774700986812.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_driver-1774700986812.jpg saved to cache
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f
2026-03-29 20:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f, skipping ID generation
2026-03-29 20:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f with scrape type 1
2026-03-29 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f sending to next pipeline
2026-03-29 20:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f, identifier: 14416221
2026-03-29 20:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f with identifier: 14416221
2026-03-29 20:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f with identifier: 14416221
2026-03-29 20:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f with identifier: 14416221 to the API
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_driver-1774700986812.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VU24 URV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14416221',
'listing': 'auction',
'location': 'Gloucestershire Gloucester',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 24323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 904498,
'Height': 2012,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_driver-1774700939597.jpg',
'Width': 2682},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505803,
'Height': 1493,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_driver-1774700986812.jpg',
'Width': 1990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523778,
'Height': 1588,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_front_passenger-1774700971585.jpg',
'Width': 2117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479172,
'Height': 1466,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6221/14416221/exterior_rear_passenger-1774700974758.jpg',
'Width': 1955},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2056039,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/6221/14416221/interior_front_seats-1774701029630.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1973129,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/6221/14416221/interior_rear_seats-1774701220937.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1970151,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6221/14416221/interior_dashboard-1774701153134.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1604764,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6221/14416221/instrument_cluster-1774717626961.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379363,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/6221/14416221/interior_boot-1774701184671.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f/d9c6fd22-7cae-5ecf-a8ea-94f27a0d6e8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1166431,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6221/14416221/docs_service_history-1774707179917.jpg?ixlib=js-3.8.0&auto=format&s=6213d2ef8f8e0b66bc18ada751178b5d',
'Width': 3072}],
'price': 12039,
'price_includes_vat': False,
'registration_date': '2024-04-10',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Aygo X Exclusive VVT-i',
'transmission': 'manual',
'trim': 'X Exclusive VVT-i',
'vin': 'JTDAGNAC800190328',
'year': 2024}
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714416221%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [motorway.uk] INFO: Saving data for 14416221: {'created_time': 1774816363.426867, 'last_price_update_time': 1774816363.426877, 'auction_closing_time': 1774884600.0}
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14416221') HTTP/1.1" 204 0
2026-03-29 20:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20339850.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 968b637b-f42f-5803-9bb5-016ccf425303 with identifier: 20339850
2026-03-29 20:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 968b637b-f42f-5803-9bb5-016ccf425303 with scrape type 1
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 968b637b-f42f-5803-9bb5-016ccf425303
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9850%252F20339850%252Fexterior_front_driver-1774692752612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9850/20339850/exterior_front_driver-1774692752612.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9850%252F20339850%252Fexterior_rear_driver-1774692772301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9850/20339850/exterior_rear_driver-1774692772301.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9850%252F20339850%252Fexterior_front_passenger-1774692779467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9850/20339850/exterior_front_passenger-1774692779467.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9850%252F20339850%252Fexterior_rear_passenger-1774692773846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9850/20339850/exterior_rear_passenger-1774692773846.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9850%252F20339850%252Finterior_front_seats-1774693229658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9850/20339850/interior_front_seats-1774693229658.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9850%252F20339850%252Finterior_rear_seats-1774693236773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9850/20339850/interior_rear_seats-1774693236773.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9850%252F20339850%252Finterior_dashboard-1774693262145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9850/20339850/interior_dashboard-1774693262145.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9850%252F20339850%252Finstrument_cluster-1774693344467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9850/20339850/instrument_cluster-1774693344467.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9850%252F20339850%252Finterior_boot-1774693271655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9850/20339850/interior_boot-1774693271655.jpg not downloaded yet
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9850%252F20339850%252Fdocs_service_history-1774693720848.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D27eec410d5b519b44bbf46273c438bd3%27 HTTP/1.1" 200 None
2026-03-29 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9850/20339850/docs_service_history-1774693720848.jpg?ixlib=js-3.8.0&auto=format&s=27eec410d5b519b44bbf46273c438bd3 not downloaded yet
2026-03-29 20:32:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.591(s), this was the 1st time calling it.
2026-03-29 20:32:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.415608854539726 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20381015.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 377cadac-65d0-5153-b332-24c5bc21adcc with identifier: 20381015
2026-03-29 20:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377cadac-65d0-5153-b332-24c5bc21adcc with scrape type 1
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Fexterior_front_driver-1774710045948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_front_driver-1774710045948.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Fexterior_rear_driver-1774710010544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_rear_driver-1774710010544.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Fexterior_front_passenger-1774710023910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_front_passenger-1774710023910.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Fexterior_rear_passenger-1774710052896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_rear_passenger-1774710052896.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20381015%252Finterior_front_seats-1774711320347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20381015/interior_front_seats-1774711320347.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20381015%252Finterior_rear_seats-1774711326192.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20381015/interior_rear_seats-1774711326192.jpg not downloaded yet
2026-03-29 20:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9850/20339850/docs_service_history-1774693720848.jpg?ixlib=js-3.8.0&auto=format&s=27eec410d5b519b44bbf46273c438bd3> (referer: None)
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Finterior_dashboard-1774711354717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/interior_dashboard-1774711354717.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Finstrument_cluster-1774711445635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/instrument_cluster-1774711445635.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20381015%252Finterior_boot-1774711333083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20381015/interior_boot-1774711333083.jpg not downloaded yet
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1015%252F20381015%252Fdocs_service_history-1774711402415.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da78490aa1a34ee72381ba3ac2c954dd8%27 HTTP/1.1" 200 None
2026-03-29 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1015/20381015/docs_service_history-1774711402415.jpg?ixlib=js-3.8.0&auto=format&s=a78490aa1a34ee72381ba3ac2c954dd8 not downloaded yet
2026-03-29 20:32:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc7a90>
2026-03-29 20:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968b637b-f42f-5803-9bb5-016ccf425303/968b637b-f42f-5803-9bb5-016ccf425303_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9850%252F20339850%252Fdocs_service_history-1774693720848.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D27eec410d5b519b44bbf46273c438bd3') HTTP/1.1" 204 0
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9850/20339850/docs_service_history-1774693720848.jpg?ixlib=js-3.8.0&auto=format&s=27eec410d5b519b44bbf46273c438bd3 saved to cache
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 968b637b-f42f-5803-9bb5-016ccf425303
2026-03-29 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1015/20381015/interior_rear_seats-1774711326192.jpg> (referer: None)
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cb3af10>
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20381015%252Finterior_rear_seats-1774711326192.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20381015/interior_rear_seats-1774711326192.jpg saved to cache
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1015/20381015/docs_service_history-1774711402415.jpg?ixlib=js-3.8.0&auto=format&s=a78490aa1a34ee72381ba3ac2c954dd8> (referer: None)
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0ce090>
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1015%252F20381015%252Fdocs_service_history-1774711402415.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da78490aa1a34ee72381ba3ac2c954dd8') HTTP/1.1" 204 0
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1015/20381015/docs_service_history-1774711402415.jpg?ixlib=js-3.8.0&auto=format&s=a78490aa1a34ee72381ba3ac2c954dd8 saved to cache
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1015/20381015/interior_boot-1774711333083.jpg> (referer: None)
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d0b2b50>
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20381015%252Finterior_boot-1774711333083.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20381015/interior_boot-1774711333083.jpg saved to cache
2026-03-29 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20381015/instrument_cluster-1774711445635.jpg> (referer: None)
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e92ba50>
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Finstrument_cluster-1774711445635.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/instrument_cluster-1774711445635.jpg saved to cache
2026-03-29 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20381015/interior_dashboard-1774711354717.jpg> (referer: None)
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0edc6490>
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Finterior_dashboard-1774711354717.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/interior_dashboard-1774711354717.jpg saved to cache
2026-03-29 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1015/20381015/interior_front_seats-1774711320347.jpg> (referer: None)
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e92a510>
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1015%252F20381015%252Finterior_front_seats-1774711320347.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1015/20381015/interior_front_seats-1774711320347.jpg saved to cache
2026-03-29 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19514884.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72c1544-f44b-53a1-86cc-360c88991b37 with identifier: 19514884
2026-03-29 20:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72c1544-f44b-53a1-86cc-360c88991b37 with scrape type 1
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b72c1544-f44b-53a1-86cc-360c88991b37
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Fexterior_front_driver-1774715277600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/exterior_front_driver-1774715277600.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Fexterior_rear_driver-1774715302576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/exterior_rear_driver-1774715302576.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Fexterior_front_passenger-1774715337886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/exterior_front_passenger-1774715337886.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Fexterior_rear_passenger-1774715333326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/exterior_rear_passenger-1774715333326.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4884%252F19514884%252Finterior_front_seats-1774715610859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4884/19514884/interior_front_seats-1774715610859.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4884%252F19514884%252Finterior_rear_seats-1774715639697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4884/19514884/interior_rear_seats-1774715639697.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Finterior_dashboard-1774715707869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/interior_dashboard-1774715707869.jpg not downloaded yet
2026-03-29 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_rear_passenger-1774710052896.jpg> (referer: None)
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4884%252F19514884%252Finterior_boot-1774715717415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4884/19514884/interior_boot-1774715717415.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4884%252F19514884%252Fdocs_service_history-1774715912308.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc87fc7492ca89f8e2cc65b10eeb6cdff%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4884/19514884/docs_service_history-1774715912308.jpg?ixlib=js-3.8.0&auto=format&s=c87fc7492ca89f8e2cc65b10eeb6cdff not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Fwheels_front_driver-1774715382761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/wheels_front_driver-1774715382761.jpg not downloaded yet
2026-03-29 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_front_passenger-1774710023910.jpg> (referer: None)
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d2c5e50>
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Fexterior_rear_passenger-1774710052896.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_rear_passenger-1774710052896.jpg saved to cache
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0eca63d0>
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_377cadac-65d0-5153-b332-24c5bc21adcc/377cadac-65d0-5153-b332-24c5bc21adcc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1015%252F20381015%252Fexterior_front_passenger-1774710023910.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1015/20381015/exterior_front_passenger-1774710023910.jpg saved to cache
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 377cadac-65d0-5153-b332-24c5bc21adcc
2026-03-29 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487216.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4884/19514884/wheels_front_driver-1774715382761.jpg> (referer: None)
2026-03-29 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4884/19514884/interior_rear_seats-1774715639697.jpg> (referer: None)
2026-03-29 20:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1af63883-1043-517f-8a6f-bc2cb8997eeb with identifier: 20487216
2026-03-29 20:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1af63883-1043-517f-8a6f-bc2cb8997eeb with scrape type 1
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_front_driver-1774710166728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_driver-1774710166728.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_rear_driver-1774710167888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_driver-1774710167888.jpg not downloaded yet
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_front_passenger-1774710169747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_passenger-1774710169747.jpg not downloaded yet
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce65550>
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72c1544-f44b-53a1-86cc-360c88991b37/b72c1544-f44b-53a1-86cc-360c88991b37_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Fwheels_front_driver-1774715382761.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/wheels_front_driver-1774715382761.jpg saved to cache
2026-03-29 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b72c1544-f44b-53a1-86cc-360c88991b37
2026-03-29 20:32:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ce16c90>
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72c1544-f44b-53a1-86cc-360c88991b37/b72c1544-f44b-53a1-86cc-360c88991b37_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4884%252F19514884%252Finterior_rear_seats-1774715639697.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4884/19514884/interior_rear_seats-1774715639697.jpg saved to cache
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b72c1544-f44b-53a1-86cc-360c88991b37
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_rear_passenger-1774710166423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_passenger-1774710166423.jpg not downloaded yet
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7216%252F20487216%252Finterior_front_seats-1774713555357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7216/20487216/interior_front_seats-1774713555357.jpg not downloaded yet
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7216%252F20487216%252Finterior_rear_seats-1774710780756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7216/20487216/interior_rear_seats-1774710780756.jpg not downloaded yet
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7216%252F20487216%252Finterior_dashboard-1774715047979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7216/20487216/interior_dashboard-1774715047979.jpg not downloaded yet
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7216%252F20487216%252Finterior_boot-1774710779706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7216/20487216/interior_boot-1774710779706.jpg not downloaded yet
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7216%252F20487216%252Fdocs_service_history-1774711518507.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D863cd65698e866197a9873e2aa6ce01f%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7216/20487216/docs_service_history-1774711518507.jpg?ixlib=js-3.8.0&auto=format&s=863cd65698e866197a9873e2aa6ce01f not downloaded yet
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fwheels_front_driver-1774710356299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/wheels_front_driver-1774710356299.jpg not downloaded yet
2026-03-29 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4884/19514884/docs_service_history-1774715912308.jpg?ixlib=js-3.8.0&auto=format&s=c87fc7492ca89f8e2cc65b10eeb6cdff> (referer: None)
2026-03-29 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4884/19514884/interior_dashboard-1774715707869.jpg> (referer: None)
2026-03-29 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4884/19514884/interior_boot-1774715717415.jpg> (referer: None)
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea86150>
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72c1544-f44b-53a1-86cc-360c88991b37/b72c1544-f44b-53a1-86cc-360c88991b37_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4884%252F19514884%252Fdocs_service_history-1774715912308.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc87fc7492ca89f8e2cc65b10eeb6cdff') HTTP/1.1" 204 0
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4884/19514884/docs_service_history-1774715912308.jpg?ixlib=js-3.8.0&auto=format&s=c87fc7492ca89f8e2cc65b10eeb6cdff saved to cache
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b72c1544-f44b-53a1-86cc-360c88991b37
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea86110>
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72c1544-f44b-53a1-86cc-360c88991b37/b72c1544-f44b-53a1-86cc-360c88991b37_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4884%252F19514884%252Finterior_dashboard-1774715707869.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4884/19514884/interior_dashboard-1774715707869.jpg saved to cache
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b72c1544-f44b-53a1-86cc-360c88991b37
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:32:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0e01f990>
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72c1544-f44b-53a1-86cc-360c88991b37/b72c1544-f44b-53a1-86cc-360c88991b37_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4884%252F19514884%252Finterior_boot-1774715717415.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4884/19514884/interior_boot-1774715717415.jpg saved to cache
2026-03-29 20:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b72c1544-f44b-53a1-86cc-360c88991b37
2026-03-29 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7216/20487216/docs_service_history-1774711518507.jpg?ixlib=js-3.8.0&auto=format&s=863cd65698e866197a9873e2aa6ce01f> (referer: None)
2026-03-29 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7216/20487216/wheels_front_driver-1774710356299.jpg> (referer: None)
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0c251e10>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7216%252F20487216%252Fdocs_service_history-1774711518507.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D863cd65698e866197a9873e2aa6ce01f') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7216/20487216/docs_service_history-1774711518507.jpg?ixlib=js-3.8.0&auto=format&s=863cd65698e866197a9873e2aa6ce01f saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ea847d0>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fwheels_front_driver-1774710356299.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/wheels_front_driver-1774710356299.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7216/20487216/interior_rear_seats-1774710780756.jpg> (referer: None)
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7216/20487216/interior_boot-1774710779706.jpg> (referer: None)
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7216/20487216/interior_dashboard-1774715047979.jpg> (referer: None)
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:12:15\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A326B\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca7df90>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7216%252F20487216%252Finterior_rear_seats-1774710780756.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7216/20487216/interior_rear_seats-1774710780756.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:12:53\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A326B\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca49590>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7216%252F20487216%252Finterior_boot-1774710779706.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7216/20487216/interior_boot-1774710779706.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xca\x08\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A326B\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 188 - value: b'A326BXXSECYB5\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 202 - value: b'2026:03:28 15:38:56\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xee\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xc4\x02\x00\x00'
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d1606d0>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7216%252F20487216%252Finterior_dashboard-1774715047979.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7216/20487216/interior_dashboard-1774715047979.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_passenger-1774710169747.jpg> (referer: None)
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7216/20487216/interior_front_seats-1774713555357.jpg> (referer: None)
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_passenger-1774710166423.jpg> (referer: None)
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_driver-1774710166728.jpg> (referer: None)
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0cacb510>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_front_passenger-1774710169747.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_passenger-1774710169747.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 15:59:05\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A326B\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:32:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0ca19b10>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7216%252F20487216%252Finterior_front_seats-1774713555357.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7216/20487216/interior_front_seats-1774713555357.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d261350>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_rear_passenger-1774710166423.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_passenger-1774710166423.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d161590>
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_front_driver-1774710166728.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_driver-1774710166728.jpg saved to cache
2026-03-29 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_driver-1774710167888.jpg> (referer: None)
2026-03-29 20:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbc0d042850>
2026-03-29 20:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7216%252F20487216%252Fexterior_rear_driver-1774710167888.jpg') HTTP/1.1" 204 0
2026-03-29 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_driver-1774710167888.jpg saved to cache
2026-03-29 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1af63883-1043-517f-8a6f-bc2cb8997eeb
2026-03-29 20:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1af63883-1043-517f-8a6f-bc2cb8997eeb, skipping ID generation
2026-03-29 20:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1af63883-1043-517f-8a6f-bc2cb8997eeb with scrape type 1
2026-03-29 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1af63883-1043-517f-8a6f-bc2cb8997eeb sending to next pipeline
2026-03-29 20:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1af63883-1043-517f-8a6f-bc2cb8997eeb, identifier: 20487216
2026-03-29 20:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1af63883-1043-517f-8a6f-bc2cb8997eeb with identifier: 20487216
2026-03-29 20:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1af63883-1043-517f-8a6f-bc2cb8997eeb with identifier: 20487216
2026-03-29 20:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1af63883-1043-517f-8a6f-bc2cb8997eeb with identifier: 20487216 to the API
2026-03-29 20:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_driver-1774710167888.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1af63883-1043-517f-8a6f-bc2cb8997eeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EJ73 WLW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487216',
'listing': 'auction',
'location': 'Essex Colchester',
'make': 'MG',
'model': '3',
'odometer': 16170,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214488,
'Height': 842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_driver-1774710166728.jpg',
'Width': 1123},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212400,
'Height': 886,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_driver-1774710167888.jpg',
'Width': 1181},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177044,
'Height': 865,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_front_passenger-1774710169747.jpg',
'Width': 1153},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180937,
'Height': 897,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7216/20487216/exterior_rear_passenger-1774710166423.jpg',
'Width': 1196},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621815,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/7216/20487216/interior_front_seats-1774713555357.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af63883-1043-517f-8a6f-bc2cb8997eeb/1af63883-1043-517f-8a6f-bc2cb8997eeb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781199,
'Height': 1080,
'OriginUrl': '